{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T19:15:18Z","timestamp":1774898118197,"version":"3.50.1"},"reference-count":38,"publisher":"Emerald","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,5,13]]},"abstract":"<jats:p>The Hadamard semidifferential is more general than the Fr\u00e9chet differential now dominant in undergraduate mathematics education. By slightly changing the definition of the forward directional derivative, the Hadamard semidifferential rescues the chain rule, enforces continuity, and permits differentiation across maxima and minima. It also plays well with convex analysis and naturally extends differentiation to smooth embedded submanifolds, topological vector spaces, and metric spaces of shapes and geometries. The current elementary exposition focuses on the more familiar territory of analysis in Euclidean spaces and applies the semidifferential to some representative problems in optimization and statistics. These include algorithms for proximal gradient descent, steepest descent in matrix completion, and variance components models.<\/jats:p>","DOI":"10.1561\/2400000041","type":"journal-article","created":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T10:31:05Z","timestamp":1715596265000},"page":"1-62","source":"Crossref","is-referenced-by-count":3,"title":["A Tutorial on Hadamard Semidifferentials"],"prefix":"10.1561","volume":"6","author":[{"given":"Kenneth","family":"Lange","sequence":"first","affiliation":[{"name":"Departments of Computational Medicine, Human Genetics, and Statistics, University of California , ,","place":["Los Angeles, USA"]}]}],"member":"140","published-online":{"date-parts":[[2024,5,13]]},"reference":[{"key":"2026033014423761600_ref001","doi-asserted-by":"crossref","DOI":"10.1515\/9781400830244","volume-title":"Optimization Algorithms on Matrix Manifolds","author":"Absil","year":"2008"},{"key":"2026033014423761600_ref002","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-8176-4848-0","volume-title":"Set-Valued Analysis","author":"Aubin","year":"2009"},{"key":"2026033014423761600_ref003","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-48311-5","volume-title":"Convex Analysis and Monotone Operator Theory in Hilbert Spaces","author":"Bauschke","year":"2017","edition":"2nd"},{"key":"2026033014423761600_ref004","first-page":"1","article-title":"Automatic differentiation in machine learning: A survey","volume":"18","author":"Baydin","year":"2018","journal-title":"Journal of Machine Learning Research"},{"key":"2026033014423761600_ref005","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611974997","volume-title":"First-Order Methods in Optimization","author":"Beck","year":"2017"},{"key":"2026033014423761600_ref006","volume-title":"Nonlinear Programming","author":"Bertsekas","year":"1999"},{"key":"2026033014423761600_ref007","doi-asserted-by":"crossref","first-page":"803","DOI":"10.3150\/11-BEJ358","article-title":"Deriving the asymptotic distribution of U-and V-statistics of dependent data using weighted empirical processes","volume":"18","author":"Beutner","year":"2012","journal-title":"Bernoulli"},{"key":"2026033014423761600_ref008","volume-title":"Convex Analysis and Nonlinear Optimization: Theory and Examples","author":"Borwein","year":"2010","edition":"2nd"},{"key":"2026033014423761600_ref009","doi-asserted-by":"crossref","DOI":"10.1017\/9781009166164","volume-title":"An Introduction to Optimization on Smooth Manifolds","author":"Boumal","year":"2023"},{"key":"2026033014423761600_ref010","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4471-4820-3","volume-title":"Functional Analysis, Calculus of Variations and Optimal Control","author":"Clarke","year":"2013"},{"key":"2026033014423761600_ref011","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1137\/0114053","article-title":"The theory of max-min, with applications","volume":"14","author":"Danskin","year":"1966","journal-title":"SIAM Journal of Applied Mathematics"},{"key":"2026033014423761600_ref012","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611975963","volume-title":"Introduction to Optimization and Hadamard Semidifferential Calculus","author":"Delfour","year":"2019","edition":"2nd"},{"key":"2026033014423761600_ref013","first-page":"1039","article-title":"Hadamard semidifferential of functions on an unstructured subset of a TVS","volume":"5","author":"Delfour","year":"2020","journal-title":"Journal of Pure Applied Functional Analysis"},{"key":"2026033014423761600_ref014","doi-asserted-by":"crossref","first-page":"1917","DOI":"10.3934\/cpaa.2021076","article-title":"Hadamard semidifferential, oriented distance function, and some applications","volume":"21","author":"Delfour","year":"2022","journal-title":"Communications on Pure and Applied Analysis"},{"key":"2026033014423761600_ref015","volume-title":"Analysis, Differential Calculus, and Optimization","author":"Delfour","year":"2011"},{"key":"2026033014423761600_ref016","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-87821-8","volume-title":"Implicit Functions and Solution Mappings: A View from Variational Analysis","author":"Dontchev","year":"2009"},{"key":"2026033014423761600_ref017","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1137\/S0895479895290954","article-title":"The geometry of algorithms with orthogonality constraints","volume":"20","author":"Edelman","year":"1998","journal-title":"SIAM Journal on Matrix Analysis and Applications"},{"key":"2026033014423761600_ref018","first-page":"617","article-title":"Systems of inequalities involving convex functions","author":"Fan"},{"key":"2026033014423761600_ref019","first-page":"845","article-title":"Sur la notion de diff\u00e9rentielle","volume":"152","author":"Fr\u00e9chet","year":"1911","journal-title":"Comptes Rendus de l\u2019Acad\u00e9mie des Sciences"},{"key":"2026033014423761600_ref020","doi-asserted-by":"crossref","first-page":"293","DOI":"10.24033\/asens.766","article-title":"La notion de diff\u00e9rentielle dans l\u2019analyse g\u00e9n\u00e9rale","volume":"XLII","author":"Fr\u00e9chet","year":"1925","journal-title":"Annales Scientifiques de l\u2019\u00c9cole Normale Sup\u00e9rieure"},{"key":"2026033014423761600_ref021","first-page":"233","article-title":"Sur la notion de diff\u00e9rentielle","volume":"16","author":"Fr\u00e9chet","year":"1937","journal-title":"Journal de Math\u00e9matiques Pures et Appliqu\u00e9es"},{"key":"2026033014423761600_ref022","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611976953","volume-title":"Transfinite Interpolations and Eule-rian\/Lagrangian Dynamics","author":"Garon","year":"2022"},{"key":"2026033014423761600_ref023","first-page":"341","article-title":"La notion de diff\u00e9rentielle dans l\u2019enseignement","volume":"19","author":"Hadamard","year":"1935","journal-title":"The Mathematical Gazette"},{"key":"2026033014423761600_ref024","article-title":"Simpler Grassmannian optimization","volume-title":"arXiv preprint","author":"Lai","year":"2020"},{"key":"2026033014423761600_ref025","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611974409","volume-title":"MM Optimization Algorithms","author":"Lange","year":"2016"},{"key":"2026033014423761600_ref026","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-74503-9","volume-title":"Linear and Nonlinear Programming","author":"Luenberger","year":"2008","edition":"3rd"},{"key":"2026033014423761600_ref027","doi-asserted-by":"crossref","DOI":"10.1002\/9781119541219","volume-title":"Matrix Differential Calculus with Applications in Statistics and Econometrics","author":"Magnus","year":"2019","edition":"3rd"},{"key":"2026033014423761600_ref028","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1137\/080743627","article-title":"Introduction to automatic differentiation and matlab object-oriented programming","volume":"52","author":"Neidinger","year":"2010","journal-title":"SIAM Review"},{"key":"2026033014423761600_ref029","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/s10107-004-0552-5","article-title":"Smooth minimization of non-smooth functions","volume":"103","author":"Nesterov","year":"2005","journal-title":"Mathematical Programming"},{"key":"2026033014423761600_ref030","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1016\/0022-1236(78)90030-7","article-title":"Calcul sous-diff\u00e9rentiel et optimisation","volume":"27","author":"Penot","year":"1978","journal-title":"Journal of Functional Analysis"},{"key":"2026033014423761600_ref031","volume-title":"The Theory of Functions of Real Variables","author":"Pierpont","year":"1905"},{"key":"2026033014423761600_ref032","volume-title":"Variational Analysis","author":"Rockafellar","year":"2009"},{"key":"2026033014423761600_ref033","doi-asserted-by":"crossref","DOI":"10.1017\/9781108917407","volume-title":"Bayesian Filtering and Smoothing","author":"S\u00e4rkk\u00e4","year":"2023"},{"key":"2026033014423761600_ref034","volume-title":"Grundz\u00fcge der Differential und Integralrechnung, I","author":"Stolz","year":"1893"},{"key":"2026033014423761600_ref035","doi-asserted-by":"crossref","first-page":"S104","DOI":"10.1137\/120876459","article-title":"Normalized iterative hard thresholding for matrix completion","volume":"35","author":"Tanner","year":"2013","journal-title":"SIAM Journal on Scientific Computing"},{"key":"2026033014423761600_ref036","volume-title":"Asymptotic Statistics","author":"Van der Vaart","year":"2000"},{"key":"2026033014423761600_ref037","doi-asserted-by":"crossref","first-page":"2553","DOI":"10.1137\/090764566","article-title":"A riemannian optimization approach for computing low-rank solutions of lyapunov equations","volume":"31","author":"Vandereycken","year":"2010","journal-title":"SIAM Journal on Matrix Analysis and Applications"},{"key":"2026033014423761600_ref038","volume-title":"The Fundamental Theorems of Differential Calculus","author":"Young","year":"1910"}],"container-title":["Foundations and Trends\u00ae in Optimization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/ftopt\/article-pdf\/6\/1\/1\/10976048\/2400000041en.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/www.emerald.com\/ftopt\/article-pdf\/6\/1\/1\/10976048\/2400000041en.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T18:42:47Z","timestamp":1774896167000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.emerald.com\/ftopt\/article\/6\/1\/1\/1324796\/A-Tutorial-on-Hadamard-Semidifferentials"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,13]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,5,13]]}},"URL":"https:\/\/doi.org\/10.1561\/2400000041","relation":{},"ISSN":["2167-3888","2167-3918"],"issn-type":[{"value":"2167-3888","type":"print"},{"value":"2167-3918","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,13]]}}}