{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T12:03:31Z","timestamp":1790683411225,"version":"4.1.0"},"reference-count":49,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"2","funder":[{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-11-1-0516"],"award-info":[{"award-number":["N00014-11-1-0516"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1216920"],"award-info":[{"award-number":["DMS-1216920"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1522747"],"award-info":[{"award-number":["DMS-1522747"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Optim."],"published-print":{"date-parts":[[2018,1]]},"abstract":"<jats:p>In this paper we consider the optimization of a functional $F$ defined as the convolution of a function $f$ with a Gaussian kernel. We propose this type of objective function for the optimization of the output of complex computational simulations, which often present some form of deterministic noise and need to be smoothed for the results to be meaningful. We introduce a derivative-free algorithm that computes trial points from the minimization of a regression model of the noisy function $f$ over a trust region. The regression model is constructed from function values at sample points that are chosen randomly around iterates and trial points of the algorithm. The weights given to the individual sample points in the regression problem are obtained according to an adaptive multiple importance sampling strategy. This has two advantages. First, it makes it possible to reuse all noisy function values collected over the course of the optimization. Second, the resulting regression model converges to the second-order Taylor approximation of the convolution functional $F$. We prove that, with probability one, each limit point of the iterates is a stationary point of $F$. Computational experiments on a set of benchmark problems with noisy functions compare the proposed algorithm with the deterministic derivative-free trust-region method the proposed method is based on. It is demonstrated that the proposed algorithm performs similarly efficiently in the early stages of the optimization and is able to overcome convergence problems of the original method, where the algorithm might get trapped in spurious local minima induced by the noise.<\/jats:p>","DOI":"10.1137\/15m1031679","type":"journal-article","created":{"date-parts":[[2018,5,8]],"date-time":"2018-05-08T11:53:02Z","timestamp":1525780382000},"page":"1478-1507","source":"Crossref","is-referenced-by-count":30,"title":["A Derivative-Free Trust-Region Algorithm for the Optimization of Functions Smoothed via Gaussian Convolution Using Adaptive Multiple Importance Sampling"],"prefix":"10.1137","volume":"28","author":[{"given":"Alvaro","family":"Maggiar","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"W\u00e4chter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Irina S.","family":"Dolinskaya","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeremy","family":"Staum","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2018,5,8]]},"reference":[{"key":"atypb1","unstructured":"L. K. Alford, R. F. Beck, J. T. Johnson, D. Lyzenga, O. Nwogu, and A. Zundel,\n                      Design, implementation, and evaluation of a system for environmental and ship motion forecasting\n                      , in Proceedings of the 30th Symposium on Naval Hydrodynamics, Hobart, Tasmania, Australia, 2014."},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1515\/156939604323091180"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-012-0578-z"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1137\/130915984"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1137\/100814688"},{"key":"atypb6","unstructured":"J. Blanchet, C. Cartis, M. Menickelly, and K. Scheinberg,\n                      Convergence Rate Analysis of a Stochastic Trust Region Method for Nonconvex Optimization\n                      , preprint, arXiv:1609.07428, 2016."},{"key":"atypb7","doi-asserted-by":"crossref","unstructured":"J. Borggaard, D. Pelletier, and K. E. Vugrin,\n                      On sensitivity analysis for problems with numerical noise\n                      , in Proceedings of the 9th AIAA\/NASA\/USAF\/ISSMO Symposium on Multidisciplinary Analysis and Optimization, American Institute of Aeronautics and Astronautics, Reston, VA, 2002,https:\/\/arc.aiaa.org\/doi\/abs\/10.2514\/6.2002-5553.","DOI":"10.2514\/6.2002-5553"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2017.2699226"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1287\/ijoc.1120.0498"},{"key":"atypb10","doi-asserted-by":"crossref","unstructured":"R. Chen, M. Menickelly, and K. Scheinberg,\n                      Stochastic optimization using a trust-region method and random models\n                      , Math. Program. (2017),https:\/\/doi.org\/10.1007\/s10107-017-1141-8.","DOI":"10.1007\/s10107-017-1141-8"},{"key":"atypb11","first-page":"10","author":"Cleveland W. S.","year":"1996","journal-title":"New York"},{"key":"atypb12","first-page":"452","author":"Conn A. R.","year":"1999","journal-title":"New York"},{"key":"atypb13","doi-asserted-by":"crossref","unstructured":"A. R. Conn, N. I. M. Gould, and P. L. Toint,\n                      Trust Region Methods\n                      , SIAM, Philadelphia, PA, 2000.","DOI":"10.1137\/1.9780898719857"},{"key":"atypb14","doi-asserted-by":"crossref","unstructured":"A. R. Conn, K. Scheinberg, and P. L. Toint,\n                      A derivative free optimization algorithm in practice\n                      , in Proceedings of 7th AIAA\/USAF\/NASA\/ISSMO Symposium on Multidisciplinary Analysis and Optimization, American Institute of Aeronautics and Astronautics, Reston, VA, 1998,https:\/\/doi.org\/10.2514\/6.1998-4718.","DOI":"10.2514\/6.1998-4718"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-006-0073-5"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1137\/060673424"},{"key":"atypb17","doi-asserted-by":"crossref","unstructured":"A. R. Conn, K. Scheinberg, and L. N. Vicente,\n                      Introduction to Derivative-Free Optimization\n                      , SIAM, Philadelphia, PA, 2009.","DOI":"10.1137\/1.9780898718768"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9469.2011.00756.x"},{"key":"atypb19","first-page":"495","author":"Custo\u0301dio A.","year":"2017","journal-title":"Philadelphia"},{"key":"atypb20","doi-asserted-by":"crossref","unstructured":"G. Deng and M. C. Ferris,\n                      Adaptation of the UOBYQA algorithm for noisy functions\n                      , in Proceedings of the 2006 Winter Simulation Conference, 2006, IEEE Press, Piscataway, NJ, pp. 312-319.","DOI":"10.1109\/WSC.2006.323088"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1080\/10556780802409296"},{"key":"atypb22","doi-asserted-by":"crossref","unstructured":"P. Glasserman,\n                      Monte Carlo Methods in Financial Engineering\n                      , Stoch. Model. Appl. Probab. 53, Springer, New York, 2004.","DOI":"10.1007\/978-0-387-21617-1"},{"key":"atypb23","first-page":"212","volume":"8","author":"Hooke R.","year":"1961","journal-title":"solution of numerical and statistical problems, J. ACM"},{"key":"atypb24","doi-asserted-by":"crossref","unstructured":"J. Jacod and P. E. Protter,\n                      Probability Essentials\n                      , 2nd ed., Universitext, Springer, Berlin, 2004.","DOI":"10.1007\/978-3-642-55682-1"},{"key":"atypb25","doi-asserted-by":"crossref","unstructured":"C. T. Kelley,\n                      Iterative Methods for Optimization\n                      , SIAM, Philadelphia, PA, 1999.","DOI":"10.1137\/1.9781611970920"},{"key":"atypb26","doi-asserted-by":"crossref","unstructured":"C. T. Kelley,\n                      Implicit Filtering\n                      , Software Environ. Tools 23, SIAM, Philadelphia, PA, 2011,https:\/\/doi.org\/10.1137\/1.9781611971903.","DOI":"10.1137\/1.9781611971903"},{"key":"atypb27","unstructured":"J. M. Larson and S. C. Billups,\n                      Stochastic Derivative-Free Optimization Using a Trust Region Framework\n                      , Technical report,http:\/\/www.optimization-online.org\/DB_FILE\/2013\/07\/3978.pdf, 2013."},{"key":"atypb28","unstructured":"A. Maggiar,\n                      Optimization of Smoothed Functionals and Applications of Nonlinear Programming to Fastest Path Finding for Vehicles in Anisotropic Media\n                      , Ph.D. thesis, Northwestern University, Evanston, IL, 2014."},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1007\/s101070100264"},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1145\/355934.355936"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1137\/080724083"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1137\/100786125"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1145\/2168773.2168777"},{"key":"atypb35","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-008-0262-5"},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/7.4.308"},{"key":"atypb37","unstructured":"H. B. Nielsen,\n                      UCTP-Test Problems for Unconstrained Optimization\n                      , Technical report, Technical University of Denmark, Kongens Lyngby, Denmark, 2000."},{"key":"atypb38","unstructured":"J. Nocedal and S. J. Wright,\n                      Numerical Optimization\n                      , 2nd ed., Springer Ser. Oper. Res. Financ. Eng., Springer, New York, 2006."},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.1017\/S0022112009005850"},{"key":"atypb40","doi-asserted-by":"publisher","DOI":"10.1109\/LGRS.2010.2043712"},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2000.10473909"},{"key":"atypb42","unstructured":"A. B. Owen,\n                      Monte Carlo Theory, Methods and Examples\n                      ,http:\/\/statweb.stanford.edu\/~owen\/mc\/, 2013."},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1007\/s101070100290"},{"key":"atypb44","doi-asserted-by":"publisher","DOI":"10.1137\/090748536"},{"key":"atypb45","unstructured":"S. Shashaani, F. Hashemi, and R. Pasupathy,\n                      Astro-df: A Class of Adaptive Sampling Trust-Region Algorithms for Derivative-Free Stochastic Optimization\n                      , preprint, arXiv:1610.06506, 2016."},{"key":"atypb46","first-page":"419","author":"Veach E.","year":"1995","journal-title":"New York"},{"key":"atypb47","doi-asserted-by":"publisher","DOI":"10.1109\/43.87597"},{"key":"atypb48","unstructured":"K. E. Vugrin,\n                      On the Effects of Noise on Parameter Identification Optimization Problems\n                      , Ph.D. thesis, Virginia Polytechnic Institute and State University, Blacksburg, VA, 2005."},{"key":"atypb49","unstructured":"A. Wa\u0308chter, J. Staum, A. Maggiar, and M. Feng,\n                      Sample Average Approximation with Adaptive Importance Sampling\n                      , Technical report, Northwestern University, Evanston, IL,http:\/\/www.optimization-online.org\/DB_HTML\/2017\/04\/5951.html, 2017."},{"key":"atypb50","doi-asserted-by":"publisher","DOI":"10.1016\/j.apor.2010.10.003"}],"container-title":["SIAM Journal on Optimization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/15M1031679","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T19:03:30Z","timestamp":1787339010000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/15M1031679"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,1]]},"references-count":49,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2018,1]]}},"alternative-id":["10.1137\/15M1031679"],"URL":"https:\/\/doi.org\/10.1137\/15m1031679","relation":{},"ISSN":["1052-6234","1095-7189"],"issn-type":[{"value":"1052-6234","type":"print"},{"value":"1095-7189","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,1]]}}}