{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,3,20]],"date-time":"2024-03-20T09:14:24Z","timestamp":1710926064947},"reference-count":52,"publisher":"University of Zielona G\u00f3ra, Poland","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2007,12,1]]},"abstract":"<jats:title>Object Library of Algorithms for Dynamic Optimization Problems: Benchmarking SQP and Nonlinear Interior Point Methods<\/jats:title><jats:p>The main purpose of this paper is to describe the design, implementation and possibilities of our object-oriented library of algorithms for dynamic optimization problems. We briefly present library classes for the formulation and manipulation of dynamic optimization problems, and give a general survey of solver classes for unconstrained and constrained optimization. We also demonstrate methods of derivative evaluation that we used, in particular automatic differentiation. Further, we briefly formulate and characterize the class of problems solved by our optimization classes. The solution of dynamic optimization problems with general constraints is performed by transformation into structured large-scale nonlinear programming problems and applying methods for nonlinear optimization. Two main algorithms of solvers for constrained dynamic optimization are presented in detail: the sequential quadratic programming (SQP) exploring the multistage structure of the dynamic optimization problem during the solution of a sequence of quadratic subproblems, and the nonlinear interior-point method implemented in a general-purpose large-scale optimizer IPOPT. At the end, we include a typical numerical example of the application of the constrained solvers to a large-scale discrete-time optimal control problem and we use the performance profiles methodology to compare the efficiency and robustness of different solvers or different options of the same solver. In conclusions, we summarize our experience gathered during the library development.<\/jats:p>","DOI":"10.2478\/v10006-007-0043-y","type":"journal-article","created":{"date-parts":[[2008,1,9]],"date-time":"2008-01-09T14:16:23Z","timestamp":1199888183000},"page":"515-537","source":"Crossref","is-referenced-by-count":10,"title":["Object Library of Algorithms for Dynamic Optimization Problems: Benchmarking SQP and Nonlinear Interior Point Methods"],"prefix":"10.61822","volume":"17","author":[{"given":"Jacek","family":"B\u0142aszczyk","sequence":"first","affiliation":[]},{"given":"Andrzej","family":"Karbowski","sequence":"additional","affiliation":[]},{"given":"Krzysztof","family":"Malinowski","sequence":"additional","affiliation":[]}],"member":"37438","reference":[{"key":"1","first-page":"127","author":"E. Arnold","year":"1994","journal-title":"An SQP-type solution method for constrained discrete-time optimal control problems"},{"key":"2","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1007\/BF02191662","article-title":"Two methods for large-scale nonlinear optimization and their comparison on a case study of hydropower optimization","volume":"2","author":"E. Arnold","year":"1994","journal-title":"Journal of Optimization Theory and Applications"},{"key":"3","unstructured":"Benson H. Y., Shanno D. F. and Vanderbei R. J. (2001): <i>Interior-point methods for nonconvex nonlinear programming: Filter methods and merit functions.<\/i> Technical Report ORFE-00-06, Operations Research and Financial Engineering, Princeton University. Available at <a target=\"_blank\" href='http:\/\/www.princeton.edu\/~rvdb\/tex\/loqo4\/loqo4_4.pdf'>http:\/\/www.princeton.edu\/~rvdb\/tex\/loqo4\/loqo4_4.pdf<\/a>"},{"key":"4","unstructured":"Benson H. Y., Shanno D. F. and Vanderbei R. J. (2002): <i>A comparative study of large-scale nonlinear optimization algorithms.<\/i> Technical Report ORFE-01-04, Operations Research and Financial Engineering, Princeton University. Available at <a target=\"_blank\" href='http:\/\/www.princeton.edu\/~rvdb\/tex\/loqo5\/loqo5_5.pdf'>http:\/\/www.princeton.edu\/~rvdb\/tex\/loqo5\/loqo5_5.pdf<\/a>"},{"key":"5","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1137\/0320018","article-title":"Projected Newton methods for optimization problems with simple constraints","volume":"2","author":"D. Bertsekas","year":"1982","journal-title":"SIAM Journal on Control and Optimization"},{"key":"6","first-page":"451","volume":"I","author":"J. B\u0142aszczyk","year":"2002a","journal-title":"Object library of algorithms for unconstrained dynamic optimization problems"},{"key":"7","first-page":"257","volume":"1","author":"J. B\u0142aszczyk","year":"2002b","journal-title":"Object library of algorithms for dynamic optimization problems without constraints or with simple bounds on control"},{"key":"8","first-page":"271","volume":"1","author":"J. B\u0142aszczyk","year":"2003","journal-title":"Object library of algorithms for dynamic optimization problems with general constraints"},{"key":"9","first-page":"550","author":"A. Bryson","year":"1998","journal-title":"Dynamic Optimization"},{"key":"10","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1137\/S1052623497325107","article-title":"An interior point algorithm for large scale nonlinear programming","volume":"4","author":"R. Byrd","year":"1999","journal-title":"SIAM Journal on Optimization"},{"key":"11","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1007\/PL00011391","article-title":"A trust region method based on interior point techniques for nonlinear programming","volume":"89","author":"R. Byrd","year":"2000","journal-title":"Mathematical Programming"},{"key":"12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/BFb0120945","article-title":"The watchdog technique for forcing convergence in algorithms for constrained optimization","volume":"16","author":"R. Chamberlain","year":"1982","journal-title":"Mathematical Programming Study"},{"key":"13","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/s101070100263","article-title":"Benchmarking optimization software with performance profiles","volume":"2","author":"E. Dolan","year":"2002","journal-title":"Mathematical Programming"},{"key":"14","author":"A. Fiacco","year":"1968","journal-title":"Nonlinear Programming: Sequential Unconstrained Minimization Techniques"},{"key":"15","author":"W. Findeisen","year":"1980","journal-title":"Theory and Computational Methods of Optimization"},{"key":"16","author":"R. Fletcher","year":"1987","journal-title":"Practical Methods of Optimization"},{"key":"17","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1137\/0805010","article-title":"An optimal positive definite update for sparse Hessian matrices","volume":"1","author":"R. Fletcher","year":"1995","journal-title":"SIAM Journal on Optimization"},{"key":"18","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s101070100244","article-title":"Nonlinear programming without a penalty function","volume":"2","author":"R. Fletcher","year":"2002","journal-title":"Mathematical Programming"},{"key":"19","unstructured":"Fletcher R., Leyffer S. and Toint Ph. L. (2006): <i>A brief history of filter methods.<\/i> Technical Report ANL\/MCS-P1372-0906, Mathematics and Computer Science Division, Argonne National Laboratory. Available at <a target=\"_blank\" href='http:\/\/www.optimization-online.org\/DB_FILE\/2006\/10\/1489.pdf'>http:\/\/www.optimization-online.org\/DB_FILE\/2006\/10\/1489.pdf<\/a>"},{"key":"20","unstructured":"Franke R. (1994): <i>Anwendung von Interior-Point-Methoden zur L\u00f6sung zeitdiskreter Optimalsteuerungsprobleme.<\/i> M.S. thesis, Techniche Universit\u00e4t Ilmenau, Fakult\u00e4t f\u00fcr Informatik und Automatsierung, Institut f\u00fcr Automatisierungsund Systemtechnik Fachgebiet Dynamik und Simulation \u00f6kologischer Systeme, Ilmenau, Germany, (in German)."},{"key":"21","unstructured":"Franke R. (1998): <i>OMUSES -A tool for the optimization of multistage systems and HQP - A solver for sparse nonlinear optimization. Version 1.5.<\/i> Department of Automation and Systems Engineering, Technical University of Ilmenau, Germany. Available at <a target=\"_blank\" href='http:\/\/ftp:\/\/ftp.systemtechnik.tu-ilmenau.de\/pub\/reports\/omuses.ps.gz'>ftp:\/\/ftp.systemtechnik.tu-ilmenau.de\/pub\/reports\/omuses.ps.gz<\/a>"},{"key":"22","first-page":"105","author":"R. Franke","year":"1997","journal-title":"Applying new numerical algorithms to the solution of discrete-time optimal control problems"},{"key":"23","unstructured":"<i>The solver Omuses\/HQP for structured large-scale constrained optimization: Algorithm, implementation, and example application.<\/i> Proceedings of the 6-th SIAM Conference on Optimization, Atlanta."},{"key":"24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/BF02591962","article-title":"A numerically stable dual method for solving strictly convex quadratic programs","volume":"1","author":"D. Goldfarb","year":"1983","journal-title":"Mathematical Programming"},{"key":"25","unstructured":"Gondzio J. (1994): <i>Multiple centrality corrections in a primal-dual method for linear programming.<\/i> Technical Report. 20, Department of Management Studies, University of Geneva, Geneva, Switzerland. Available at <a target=\"_blank\" href='http:\/\/www.maths.ed.ac.uk\/~gondzio\/software\/correctors.ps'>http:\/\/www.maths.ed.ac.uk\/~gondzio\/software\/correctors.ps<\/a>"},{"key":"26","unstructured":"Griewank A., Juedes D., Mitev H., Utke J., Vogel O. and Walther A. (1999): <i>ADOL-C: A package for the automatic differentiation of algorithms written in C\/C++, Version 1.8.2<\/i>, March 1999. Available at <a target=\"_blank\" href='http:\/\/www.math.tu-dresden.de\/~adol-c\/'>http:\/\/www.math.tu-dresden.de\/~adol-c\/<\/a>"},{"key":"27","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1007\/BF02579150","article-title":"A new polynomial-time algorithm for linear programming","volume":"4","author":"N. Karmarkar","year":"1984","journal-title":"Combinatorica"},{"key":"28","doi-asserted-by":"crossref","DOI":"10.1201\/9781420036022","author":"R. Luus","year":"2000","journal-title":"Iterative Dynamic Programming"},{"key":"29","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1137\/0802028","article-title":"On the implementation of a primal-dual interior point method","volume":"4","author":"S. Mehrotra","year":"1992","journal-title":"SIAM Journal on Optimization"},{"key":"30","unstructured":"Misc J.-P. (2003): <i>Large scale nonconvex optimization.<\/i><i>SIAM's SIAG\/OPT Newsletter Views-and-News<\/i>, Vol. 14, No. 1, pp. 1-25. Available at <a target=\"_blank\" href='http:\/\/fewcal.uvt.nl\/sturm\/siagopt\/vn14_1.pdf'>http:\/\/fewcal.uvt.nl\/sturm\/siagopt\/vn14_1.pdf<\/a>"},{"key":"31","unstructured":"Morales J. L., Nocedal J., Waltz R. A., Liu G. and Goux J.-P. (2001): <i>Assessing the potential of interior methods for nonlinear optimization.<\/i> Technical Report OTC 2001\/4, Optimization Technology Center of Northwestern University. Available at <a target=\"_blank\" href='http:\/\/www.ece.northwestern.edu\/~morales\/PSfiles\/assess.ps'>http:\/\/www.ece.northwestern.edu\/~morales\/PSfiles\/assess.ps<\/a>"},{"key":"32","doi-asserted-by":"crossref","DOI":"10.1007\/b98874","author":"J. Nocedal","year":"1999","journal-title":"Numerical Optimization"},{"key":"33","doi-asserted-by":"crossref","first-page":"1539","DOI":"10.1080\/00207178808906114","article-title":"Differential dynamic programming and Newton's method","volume":"5","author":"J. De O. Pantoja","year":"1988","journal-title":"International Journal of Control"},{"key":"34","first-page":"144","author":"M. Powell","year":"1978","journal-title":"A fast algorithm for nonlinearly constrained optimization calculations"},{"key":"35","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1007\/BFb0121074","article-title":"On the quadratic programming algorithm of Goldfarb and Idnani","volume":"25","author":"M. Powell","year":"1985","journal-title":"Mathematical Programming Study"},{"key":"36","unstructured":"Salahi M., Peng J. and Terlaky T. (2005): <i>On Mehrotratype predictor-corrector algorithms.<\/i> Technical report, Advanced Optimization Lab, Department of Computing and Software, McMaster University, Hamilton, Ontario, Canada. Available at <a target=\"_blank\" href='http:\/\/www.optimization-online.org\/DB_FILE\/2005\/03\/1104.pdf'>http:\/\/www.optimization-online.org\/DB_FILE\/2005\/03\/1104.pdf<\/a>"},{"key":"37","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-46424-9","author":"K. Schittkowski","year":"1980","journal-title":"Nonlinear Programming Codes: Information, Tests, Performance"},{"key":"38","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1080\/02331938308842847","article-title":"On the convergence of a sequential quadratic programming method with an augmented Lagrangian line search function","volume":"2","author":"K. Schittkowski","year":"1983","journal-title":"Mathematishe Operations Forschung und Statistik, Ser. Optimization"},{"key":"39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1023\/A:1022690711754","article-title":"Family of projected descent methods for optimization problems with simple bounds","volume":"1","author":"A. Schwartz","year":"1997","journal-title":"Journal of Optimization Theory and Applications"},{"key":"40","unstructured":"Tenny M. J., Wright S. J. and Rawlings J. B. (2002): <i>Nonlinear model predictive control via feasibility-perturbed sequential quadratic programming.<\/i> Technical Report TWMCC-2002-02, Texas-Wisconsin Modeling and Control Consortium. Available at <a target=\"_blank\" href='http:\/\/jbrwww.che.wisc.edu\/jbr-group\/tech-reports\/twmcc-2002-02.pdf'>http:\/\/jbrwww.che.wisc.edu\/jbr-group\/tech-reports\/twmcc-2002-02.pdf<\/a>"},{"key":"41","unstructured":"Tits A. L., W\u00e4chter A., Bakhtiari S., Urban T. J. and Lawrence C.T. (2002): <i>A primal-dual interior-point method for nonlinear programming with strong global and local convergence properties.<\/i> Technical Report TR 2002-29, Institute for Systems Research, University of Maryland. Available at <a target=\"_blank\" href='http:\/\/www.ee.umd.edu\/~andre\/pdiprev.ps'>http:\/\/www.ee.umd.edu\/~andre\/pdiprev.ps<\/a>"},{"key":"42","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1007\/s10107-003-0477-4","article-title":"A globally convergent primal-dual interior-point filter method for nonlinear programming","volume":"2","author":"M. Ulbrich","year":"2004","journal-title":"Mathematical Programming"},{"key":"43","unstructured":"Vanderbei R. J. and Shanno D. F. (1997): <i>An interior-point algorithm for non-convex nonlinear programming.<\/i> Technical Report SOR-97-21, Statistics and Operations Research, Princeton University. Available at <a target=\"_blank\" href='http:\/\/www.sor.princeton.edu\/~rvdb\/ps\/nonlin.ps.gz'>http:\/\/www.sor.princeton.edu\/~rvdb\/ps\/nonlin.ps.gz<\/a>"},{"key":"44","unstructured":"W\u00e4chter A. (2002): <i>An Interior Point Algorithm for Large-Scale Nonlinear Optimization with Applications in Process Engineering.<\/i> Ph.D. dissertation, Department of Chemical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA. Available at <a target=\"_blank\" href='http:\/\/www.research.ibm.com\/people\/a\/andreasw\/papers\/thesis.pdf'>http:\/\/www.research.ibm.com\/people\/a\/andreasw\/papers\/thesis.pdf<\/a>"},{"key":"45","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1007\/PL00011386","article-title":"Failure of global convergence for a class of interior point methods for nonlinear programming","volume":"3","author":"A. W\u00e4chter","year":"2000","journal-title":"Mathematical Programming"},{"key":"46","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1137\/S1052623403426556","article-title":"Line search filter methods for nonlinear programming: Motivation and global convergence","volume":"1","author":"A. W\u00e4chter","year":"2005","journal-title":"SIAM Journal on Optimization"},{"key":"47","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/s10107-004-0559-y","article-title":"On the implementation of a primal-dual interior-point filter line-search algorithm for large-scale nonlinear programming","volume":"1","author":"A. W\u00e4chter","year":"2006","journal-title":"Mathematical Programming"},{"key":"48","unstructured":"Waltz R. A. and Plantenga T. (2006): <i>KNITRO 5.0 User's Manual.<\/i> Available at <a target=\"_blank\" href='http:\/\/www.ziena.com\/docs\/knitroman.pdf'>http:\/\/www.ziena.com\/docs\/knitroman.pdf<\/a>"},{"key":"49","author":"A. Wierzbicki","year":"1984","journal-title":"Models and Sensitivity of Control Systems"},{"key":"50","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/BF00940784","article-title":"Interior point methods for optimal control of discrete time systems","volume":"1","author":"S. Wright","year":"1993","journal-title":"Journal of Optimization Theory and Applications"},{"key":"51","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611971453","author":"S. Wright","year":"1997","journal-title":"Primal-Dual Interior-Point Methods"},{"key":"52","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/0096-3003(84)90051-1","article-title":"Computational aspects of discrete-time optimal control","volume":"1","author":"S. Yakowitz","year":"1984","journal-title":"Applied Mathematics and Computation"}],"container-title":["International Journal of Applied Mathematics and Computer Science"],"original-title":[],"link":[{"URL":"http:\/\/content.sciendo.com\/view\/journals\/amcs\/17\/4\/article-p515.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/view\/j\/amcs.2007.17.issue-4\/v10006-007-0043-y\/v10006-007-0043-y.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,29]],"date-time":"2024-02-29T10:27:39Z","timestamp":1709202459000},"score":1,"resource":{"primary":{"URL":"https:\/\/content.sciendo.com\/doi\/10.2478\/v10006-007-0043-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,12,1]]},"references-count":52,"journal-issue":{"issue":"4"},"URL":"https:\/\/doi.org\/10.2478\/v10006-007-0043-y","relation":{},"ISSN":["1641-876X"],"issn-type":[{"value":"1641-876X","type":"print"}],"subject":[],"published":{"date-parts":[[2007,12,1]]}}}