{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T07:48:06Z","timestamp":1778917686508,"version":"3.51.4"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,1,7]],"date-time":"2019-01-07T00:00:00Z","timestamp":1546819200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Found Comput Math"],"published-print":{"date-parts":[[2020,2]]},"DOI":"10.1007\/s10208-018-09409-5","type":"journal-article","created":{"date-parts":[[2019,1,8]],"date-time":"2019-01-08T22:21:05Z","timestamp":1546986065000},"page":"119-154","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":114,"title":["Stochastic Subgradient Method Converges on Tame Functions"],"prefix":"10.1007","volume":"20","author":[{"given":"Damek","family":"Davis","sequence":"first","affiliation":[]},{"given":"Dmitriy","family":"Drusvyatskiy","sequence":"additional","affiliation":[]},{"given":"Sham","family":"Kakade","sequence":"additional","affiliation":[]},{"given":"Jason D.","family":"Lee","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2019,1,7]]},"reference":[{"key":"9409_CR1","unstructured":"M. Abadi, A. Agarwal, P. Barham, E. Brevdo, et\u00a0al. TensorFlow: Large-scale machine learning on heterogeneous systems, 2015. Software available from tensorflow.org."},{"issue":"1","key":"9409_CR2","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1137\/S0363012904439301","volume":"44","author":"M Bena\u00efm","year":"2005","unstructured":"M. Bena\u00efm, J. Hofbauer, and S. Sorin. Stochastic approximations and differential inclusions. SIAM J. Control Optim., 44(1):328\u2013348, 2005.","journal-title":"SIAM J. Control Optim."},{"issue":"4","key":"9409_CR3","doi-asserted-by":"publisher","first-page":"673","DOI":"10.1287\/moor.1060.0213","volume":"31","author":"M Bena\u00efm","year":"2006","unstructured":"M. Bena\u00efm, J. Hofbauer, and S. Sorin. Stochastic approximations and differential inclusions. II. Applications. Math. Oper. Res., 31(4):673\u2013695, 2006.","journal-title":"II. Applications. Math. Oper. Res."},{"issue":"2","key":"9409_CR4","doi-asserted-by":"publisher","first-page":"556","DOI":"10.1137\/060670080","volume":"18","author":"J Bolte","year":"2007","unstructured":"J. Bolte, A. Daniilidis, A.S. Lewis, and M. Shiota. Clarke subgradients of stratifiable functions. SIAM Journal on Optimization, 18(2):556\u2013572, 2007.","journal-title":"SIAM Journal on Optimization"},{"key":"9409_CR5","unstructured":"V.S. Borkar. Stochastic approximation. Cambridge University Press, Cambridge; Hindustan Book Agency, New Delhi, 2008. A dynamical systems viewpoint."},{"issue":"11","key":"9409_CR6","doi-asserted-by":"publisher","first-page":"3221","DOI":"10.1090\/S0002-9939-00-05914-1","volume":"128","author":"JM Borwein","year":"2000","unstructured":"J.M. Borwein and X. Wang. Lipschitz func tions with maximal Clarke subdifferentials are generic. Proc. Amer. Math. Soc., 128(11):3221\u20133229, 2000.","journal-title":"Proc. Amer. Math. Soc."},{"key":"9409_CR7","unstructured":"H. Br\u00e9zis. Op\u00e9rateurs maximaux monotones et semi-groupes de contraction dans des espaces de Hilbert. North-Holland Math. Stud. 5, North-Holland, Amsterdam, 1973."},{"key":"9409_CR8","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/0022-1236(75)90027-0","volume":"18","author":"RE Bruck Jr","year":"1975","unstructured":"R.E. Bruck, Jr. Asymptotic convergence of nonlinear contraction semigroups in Hilbert space. J. Funct. Anal., 18:15\u201326, 1975.","journal-title":"J. Funct. Anal."},{"key":"9409_CR9","unstructured":"J.V. Burke, X.\u00a0Chen, and H.\u00a0Sun. Subdifferentiation and smoothing of nonsmooth integral functionals. Preprint, Optimization-Online, May 2017."},{"key":"9409_CR10","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1090\/S0002-9947-1975-0367131-6","volume":"205","author":"FH Clarke","year":"1975","unstructured":"F.H. Clarke. Generalized gradients and applications. Trans. Amer. Math. Soc., 205:247\u2013262, 1975.","journal-title":"Trans. Amer. Math. Soc."},{"key":"9409_CR11","unstructured":"F.H. Clarke. Optimization and nonsmooth analysis, volume\u00a05 of Classics in Applied Mathematics. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, second edition, 1990."},{"key":"9409_CR12","unstructured":"F.H. Clarke, Y.S. Ledyaev, R.J. Stern, and P.R. Wolenski. Nonsmooth analysis and control theory, volume 178. Springer Science & Business Media, 2008."},{"key":"9409_CR13","unstructured":"M.\u00a0Coste. An introduction to o-minimal geometry. RAAG Notes, 81 pages, Institut de Recherche Math\u00e9matiques de Rennes, November 1999."},{"key":"9409_CR14","unstructured":"M.\u00a0Coste. An Introduction to Semialgebraic Geometry. RAAG Notes, 78 pages, Institut de Recherche Math\u00e9matiques de Rennes, October 2002."},{"key":"9409_CR15","unstructured":"D.\u00a0Davis and D.\u00a0Drusvyatskiy. Stochastic model-based minimization of weakly convex functions. To Appear in SIAM J. Optim.,\n\narXiv:1803.06523\n\n, 2018."},{"key":"9409_CR16","unstructured":"D.\u00a0Davis and D.\u00a0Drusvyatskiy. Stochastic subgradient method converges at the rate \n$${O}(k^{-1\/4})$$\n\n\n\n\nO\n(\n\nk\n\n-\n1\n\/\n4\n\n\n)\n\n\n\n\n on weakly convex functions. \narXiv:1802.02988\n\n, 2018."},{"key":"9409_CR17","unstructured":"A.\u00a0Dembo. Probability theory: Stat310\/math230 september 3, 2016. 2016. Available at \nhttp:\/\/statweb.stanford.edu\/~adembo\/stat-310b\/lnotes.pdf\n\n."},{"issue":"1","key":"9409_CR18","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1137\/130920216","volume":"53","author":"D Drusvyatskiy","year":"2015","unstructured":"D.\u00a0Drusvyatskiy, A.D. Ioffe, and A.S. Lewis. Curves of descent. SIAM J. Control Optim., 53(1):114\u2013138, 2015.","journal-title":"SIAM J. Control Optim."},{"key":"9409_CR19","unstructured":"J.C. Duchi and F.\u00a0Ruan. Stochastic methods for composite optimization problems. Preprint \narXiv:1703.08570\n\n, 2017."},{"issue":"4","key":"9409_CR20","doi-asserted-by":"publisher","first-page":"2341","DOI":"10.1137\/120880811","volume":"23","author":"S Ghadimi","year":"2013","unstructured":"S.\u00a0Ghadimi and G.\u00a0Lan. Stochastic first- and zeroth-order methods for nonconvex stochastic programming. SIAM J. Optim., 23(4):2341\u20132368, 2013.","journal-title":"SIAM J. Optim."},{"issue":"09","key":"9409_CR21","doi-asserted-by":"publisher","first-page":"3111","DOI":"10.1090\/S0002-9939-08-09101-6","volume":"136","author":"A. D. Ioffe","year":"2008","unstructured":"A.D. Ioffe. Critical values of set-valued maps with stratifiable graphs. Extensions of Sard and Smale-Sard theorems. Proc. Amer. Math. Soc., 136(9):3111\u20133119, 2008.","journal-title":"Proceedings of the American Mathematical Society"},{"issue":"4","key":"9409_CR22","doi-asserted-by":"publisher","first-page":"1894","DOI":"10.1137\/080722059","volume":"19","author":"AD Ioffe","year":"2008","unstructured":"A.D. Ioffe. An invitation to tame optimization. SIAM J. Optim., 19(4):1894\u20131917, 2008.","journal-title":"SIAM J. Optim."},{"key":"9409_CR23","doi-asserted-by":"crossref","unstructured":"A.D. Ioffe. Variational analysis of regular mappings. Springer Monographs in Mathematics. Springer, Cham, 2017. Theory and applications.","DOI":"10.1007\/978-3-319-64277-2"},{"key":"9409_CR24","unstructured":"S.\u00a0Kakade and J.D. Lee. Provably correct automatic subdifferentiation for qualified programs. arXiv preprint \narXiv:1809.08530\n\n, 2018."},{"issue":"4","key":"9409_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2491491.2491493","volume":"39","author":"Kamil A. Khan","year":"2013","unstructured":"K.A. Khan and P.I. Barton. Evaluating an element of the Clarke generalized Jacobian of a composite piecewise differentiable function. ACM Trans. Math. Software, 39(4):Art. 23, 28, 2013.","journal-title":"ACM Transactions on Mathematical Software"},{"issue":"6","key":"9409_CR26","doi-asserted-by":"publisher","first-page":"1185","DOI":"10.1080\/10556788.2015.1025400","volume":"30","author":"KA Khan","year":"2015","unstructured":"K.A. Khan and P.I. Barton. A vector forward mode of automatic differentiation for generalized derivative evaluation. Optimization Methods and Software, 30(6):1185\u20131212, 2015.","journal-title":"Optimization Methods and Software"},{"key":"9409_CR27","unstructured":"H.J. Kushner and G.G. Yin. Stochastic approximation and recursive algorithms and applications, volume\u00a035 of Applications of Mathematics (New York). Springer-Verlag, New York, second edition, 2003. Stochastic Modelling and Applied Probability."},{"key":"9409_CR28","unstructured":"S.\u00a0\u0141ojasiewicz. Ensemble semi-analytiques. IHES Lecture Notes, 1965."},{"key":"9409_CR29","unstructured":"S.\u00a0Majewski, B.\u00a0Miasojedow, and E.\u00a0Moulines. Analysis of nonsmooth stochastic approximation: the differential inclusion approach. Preprint \narXiv:1805.01916\n\n, 2018."},{"issue":"4","key":"9409_CR30","doi-asserted-by":"publisher","first-page":"1574","DOI":"10.1137\/070704277","volume":"19","author":"A Nemirovski","year":"2008","unstructured":"A.\u00a0Nemirovski, A.\u00a0Juditsky, G.\u00a0Lan, and A.\u00a0Shapiro. Robust stochastic approximation approach to stochastic programming. SIAM J. Optim., 19(4):1574\u20131609, 2008.","journal-title":"SIAM J. Optim."},{"key":"9409_CR31","volume-title":"Problem complexity and method efficiency in optimization","author":"AS Nemirovsky","year":"1983","unstructured":"A.S. Nemirovsky and D.B. Yudin. Problem complexity and method efficiency in optimization. A Wiley-Interscience Publication. John Wiley & Sons, Inc., New York, 1983."},{"issue":"4","key":"9409_CR32","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1007\/BF01071541","volume":"10","author":"EA Nurminskii","year":"1974","unstructured":"E.A. Nurminskii. Minimization of nondifferentiable functions in the presence of noise. Cybernetics, 10(4):619\u2013621, Jul 1974.","journal-title":"Cybernetics"},{"key":"9409_CR33","unstructured":"A.\u00a0Paszke, S.\u00a0Gross, S.\u00a0Chintala, G.\u00a0Chanan, E.\u00a0Yang, Z.\u00a0DeVito, Z.\u00a0Lin, A.\u00a0Desmaison, L.\u00a0Antiga, and A.\u00a0Lerer. Automatic differentiation in pytorch. In NIPS-W, 2017."},{"key":"9409_CR34","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1214\/aoms\/1177729586","volume":"22","author":"H Robbins","year":"1951","unstructured":"H.\u00a0Robbins and S.\u00a0Monro. A stochastic approximation method. Ann. Math. Statistics, 22:400\u2013407, 1951.","journal-title":"Ann. Math. Statistics"},{"key":"9409_CR35","unstructured":"R.T. Rockafellar. The theory of subgradients and its applications to problems of optimization, volume\u00a01 of R & E. Heldermann Verlag, Berlin, 1981."},{"key":"9409_CR36","doi-asserted-by":"crossref","unstructured":"R.T. Rockafellar and R.J-B. Wets. Variational Analysis. Grundlehren der mathematischen Wissenschaften, Vol 317, Springer, Berlin, 1998.","DOI":"10.1007\/978-3-642-02431-3"},{"key":"9409_CR37","doi-asserted-by":"crossref","unstructured":"G.V. Smirnov. Introduction to the theory of differential inclusions, volume\u00a041 of Graduate Studies in Mathematics. American Mathematical Society, Providence, RI, 2002.","DOI":"10.1090\/gsm\/041"},{"key":"9409_CR38","doi-asserted-by":"crossref","unstructured":"T.\u00a0Tao. An introduction to measure theory, volume 126. American Mathematical Soc., 2011.","DOI":"10.1090\/gsm\/126\/01"},{"key":"9409_CR39","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1215\/S0012-7094-96-08416-1","volume":"84","author":"L Dries van den","year":"1996","unstructured":"L.\u00a0van\u00a0den Dries and C.\u00a0Miller. Geometric categories and o-minimal structures. Duke Math. J., 84:497\u2013540, 1996.","journal-title":"Duke Math. J."},{"issue":"4","key":"9409_CR40","doi-asserted-by":"publisher","first-page":"514","DOI":"10.1215\/S0012-7094-35-00138-7","volume":"1","author":"Hassler Whitney","year":"1935","unstructured":"H.\u00a0Whitney. A function not constant on a connected set of critical points. Duke Math. J., 1(4):514\u2013517, 12 1935.","journal-title":"Duke Mathematical Journal"},{"issue":"4","key":"9409_CR41","doi-asserted-by":"publisher","first-page":"1051","DOI":"10.1090\/S0894-0347-96-00216-0","volume":"9","author":"AJ Wilkie","year":"1996","unstructured":"A.J. Wilkie. Model completeness results for expansions of the ordered field of real numbers by restricted Pfaffian functions and the exponential function. J. Amer. Math. Soc., 9(4):1051\u20131094, 1996.","journal-title":"J. Amer. Math. Soc."}],"container-title":["Foundations of Computational Mathematics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10208-018-09409-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10208-018-09409-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10208-018-09409-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,1,28]],"date-time":"2020-01-28T23:01:47Z","timestamp":1580252507000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10208-018-09409-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,7]]},"references-count":41,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,2]]}},"alternative-id":["9409"],"URL":"https:\/\/doi.org\/10.1007\/s10208-018-09409-5","relation":{},"ISSN":["1615-3375","1615-3383"],"issn-type":[{"value":"1615-3375","type":"print"},{"value":"1615-3383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,7]]},"assertion":[{"value":"26 May 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 October 2018","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 November 2018","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 January 2019","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}