{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T06:40:14Z","timestamp":1785220814799,"version":"3.55.0"},"reference-count":103,"publisher":"Springer Science and Business Media LLC","issue":"16","license":[{"start":{"date-parts":[[2022,5,20]],"date-time":"2022-05-20T00:00:00Z","timestamp":1653004800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,5,20]],"date-time":"2022-05-20T00:00:00Z","timestamp":1653004800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004270","name":"Royal Institute of Technology","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004270","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Supercomput"],"published-print":{"date-parts":[[2022,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Large-scale numerical optimization problems arise from many fields and have applications in both industrial and academic contexts. Finding solutions to such optimization problems efficiently requires algorithms that are able to leverage the increasing parallelism available in modern computing hardware. In this paper, we review previous work on parallelizing algorithms for nonlinear optimization. To introduce the topic, the paper starts by giving an accessible introduction to nonlinear optimization and high-performance computing. This is followed by a survey of previous work on parallelization and utilization of high-performance computing hardware for nonlinear optimization algorithms. Finally, we present a number of optimization software libraries and how they are able to utilize parallel computing today. This study can serve as an introduction point for researchers interested in nonlinear optimization or high-performance computing, as well as provide ideas and inspiration for future work combining these topics.<\/jats:p>","DOI":"10.1007\/s11227-022-04555-8","type":"journal-article","created":{"date-parts":[[2022,5,20]],"date-time":"2022-05-20T16:03:27Z","timestamp":1653062607000},"page":"17513-17542","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["A survey of HPC algorithms and frameworks for large-scale gradient-based nonlinear optimization"],"prefix":"10.1007","volume":"78","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6865-9379","authenticated-orcid":false,"given":"Felix","family":"Liu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Albin","family":"Fredriksson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefano","family":"Markidis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,5,20]]},"reference":[{"issue":"5","key":"4555_CR1","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1080\/028418600750013267","volume":"39","author":"A Brahme","year":"2000","unstructured":"Brahme A (2000) Development of radiation therapy optimization. Acta Oncol 39(5):579\u2013595","journal-title":"Acta Oncol"},{"issue":"3","key":"4555_CR2","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1007\/s12667-012-0056-y","volume":"3","author":"S Frank","year":"2012","unstructured":"Frank S, Steponavice I, Rebennack S (2012) Optimal power flow: a bibliographic survey i. Energy Syst 3(3):221\u2013258","journal-title":"Energy Syst"},{"issue":"1","key":"4555_CR3","first-page":"497","volume":"135","author":"AV Rao","year":"2009","unstructured":"Rao AV (2009) A survey of numerical methods for optimal control. Adv Astronaut Sci 135(1):497\u2013528","journal-title":"Adv Astronaut Sci"},{"issue":"2","key":"4555_CR4","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1007\/s10288-018-0378-2","volume":"16","author":"V Piccialli","year":"2018","unstructured":"Piccialli V, Sciandrone M (2018) Nonlinear optimization and support vector machines. 4OR 16(2):111\u2013149","journal-title":"4OR"},{"key":"4555_CR5","volume-title":"Nonlinear optimization with financial applications","author":"M Bartholomew-Biggs","year":"2006","unstructured":"Bartholomew-Biggs M (2006) Nonlinear optimization with financial applications. Springer, New York, NY, USA"},{"key":"4555_CR6","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/j.epsr.2016.02.008","volume":"136","author":"F Capitanescu","year":"2016","unstructured":"Capitanescu F (2016) Critical review of recent advances and further developments needed in ac optimal power flow. Electric Power Syst Res 136:57\u201368","journal-title":"Electric Power Syst Res"},{"issue":"4","key":"4555_CR7","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1088\/0031-9155\/59\/4\/R151","volume":"59","author":"X Jia","year":"2014","unstructured":"Jia X, Ziegenhein P, Jiang SB (2014) Gpu-based high-performance computing for radiation therapy. Phys Med Biol 59(4):151","journal-title":"Phys Med Biol"},{"key":"4555_CR8","doi-asserted-by":"publisher","DOI":"10.1007\/b98874","volume-title":"Numerical Optimization","author":"J Nocedal","year":"1999","unstructured":"Nocedal J, Wright SJ (1999) Numerical Optimization. Springer, New York, NY, USA"},{"key":"4555_CR9","volume-title":"Optimization theory and methods: nonlinear programming","author":"W Sun","year":"2006","unstructured":"Sun W, Yuan Y-X (2006) Optimization theory and methods: nonlinear programming, vol 1. Springer, Boston, MA, USA"},{"issue":"4","key":"4555_CR10","doi-asserted-by":"publisher","first-page":"525","DOI":"10.1137\/S0036144502414942","volume":"44","author":"A Forsgren","year":"2002","unstructured":"Forsgren A, Gill PE, Wright MH (2002) Interior methods for nonlinear optimization. SIAM Rev 44(4):525\u2013597","journal-title":"SIAM Rev"},{"issue":"3","key":"4555_CR11","doi-asserted-by":"publisher","first-page":"587","DOI":"10.1016\/j.ejor.2011.09.017","volume":"218","author":"J Gondzio","year":"2012","unstructured":"Gondzio J (2012) Interior point methods 25 years later. Eur J Oper Res 218(3):587\u2013601","journal-title":"Eur J Oper Res"},{"issue":"4","key":"4555_CR12","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1137\/0802028","volume":"2","author":"S Mehrotra","year":"1992","unstructured":"Mehrotra S (1992) On the implementation of a primal-dual interior point method. SIAM J Optim 2(4):575\u2013601","journal-title":"SIAM J Optim"},{"issue":"2","key":"4555_CR13","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1007\/BF00249643","volume":"6","author":"J Gondzio","year":"1996","unstructured":"Gondzio J (1996) Multiple centrality corrections in a primal-dual method for linear programming. Comput Optim Appl 6(2):137\u2013156","journal-title":"Comput Optim Appl"},{"key":"4555_CR14","unstructured":"Wilson RB (1963) A simplicial algorithm for concave programming. PhD thesis, Harvard University"},{"key":"4555_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1017\/S0962492900002518","volume":"4","author":"PT Boggs","year":"1995","unstructured":"Boggs PT, Tolle JW (1995) Sequential quadratic programming. Acta Numerica 4:1\u201351","journal-title":"Acta Numerica"},{"key":"4555_CR16","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1007\/978-1-4614-1927-3_6","volume-title":"Mixed integer nonlinear programming","author":"PE Gill","year":"2012","unstructured":"Gill PE, Wong E (2012) Sequential quadratic programming methods. Mixed integer nonlinear programming. Springer, NewYork, pp 147\u2013224"},{"key":"4555_CR17","doi-asserted-by":"crossref","unstructured":"Griva I, Nash SG, Sofer A (2009) Linear and nonlinear optimization. Siam, Philadelphia. Chap. 15.5","DOI":"10.1137\/1.9780898717730"},{"key":"4555_CR18","doi-asserted-by":"crossref","unstructured":"B\u00fcskens C, Wassel D (2012) The esa nlp solver worhp. In: Modeling and optimization in space engineering, pp. 85\u2013110. Springer, New York","DOI":"10.1007\/978-1-4614-4469-5_4"},{"key":"4555_CR19","unstructured":"Wong E (2011) Active-set methods for quadratic programming. PhD thesis, University of California, San Diego"},{"key":"4555_CR20","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1007\/978-0-387-40065-5_17","volume":"1","author":"J Nocedal","year":"2006","unstructured":"Nocedal J, Wright SJ (2006) Penalty and augmented lagrangian methods. Numer Opt 1:497\u2013528","journal-title":"Numer Opt"},{"key":"4555_CR21","volume-title":"Distributed optimization and statistical learning via the alternating direction method of multipliers","author":"S Boyd","year":"2011","unstructured":"Boyd S, Parikh N, Chu E (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Now Publishers Inc, Hanover, MA, USA"},{"key":"4555_CR22","unstructured":"Conn AR, Gould G, Toint PL (2013) LANCELOT: a fortran package for large-scale nonlinear optimization (Release A) vol. 17. Springer, Berlin, Heidelberg, New York"},{"key":"4555_CR23","volume-title":"Evolutionary optimization algorithms","author":"D Simon","year":"2013","unstructured":"Simon D (2013) Evolutionary optimization algorithms. Wiley, Hoboken, NJ, USA"},{"key":"4555_CR24","doi-asserted-by":"crossref","unstructured":"Zhang Y, Wang S, Ji G (2015) A comprehensive survey on particle swarm optimization algorithm and its applications. Mathematical problems in engineering","DOI":"10.1155\/2015\/931256"},{"issue":"1","key":"4555_CR25","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1214\/ss\/1177011077","volume":"8","author":"D Bertsimas","year":"1993","unstructured":"Bertsimas D, Tsitsiklis J (1993) Simulated annealing. Stat Sci 8(1):10\u201315","journal-title":"Stat Sci"},{"key":"4555_CR26","doi-asserted-by":"publisher","DOI":"10.1002\/0471739383","volume-title":"Parallel metaheuristics: a new class of algorithms","author":"E Alba","year":"2005","unstructured":"Alba E (2005) Parallel metaheuristics: a new class of algorithms. Wiley, Hoboken, NJ, USA"},{"issue":"4","key":"4555_CR27","doi-asserted-by":"publisher","first-page":"2899","DOI":"10.1007\/s13369-018-03713-6","volume":"44","author":"S Lalwani","year":"2019","unstructured":"Lalwani S, Sharma H, Satapathy SC, Deep K, Bansal JC (2019) A survey on parallel particle swarm optimization algorithms. Arab J Sci Eng 44(4):2899\u20132923","journal-title":"Arab J Sci Eng"},{"key":"4555_CR28","volume-title":"Eng Design Opt","author":"JR Martins","year":"2021","unstructured":"Martins JR, Ning A (2021) Eng Design Opt. Cambridge University Press, Cambridge, United Kingdom"},{"key":"4555_CR29","doi-asserted-by":"crossref","unstructured":"Tufo HM, Fischer PF (1999) Terascale spectral element algorithms and implementations. In: Proceedings of the 1999 ACM\/IEEE Conference on Supercomputing, p 68","DOI":"10.1145\/331532.331599"},{"key":"4555_CR30","unstructured":"Coates A., Huval B, Wang T, Wu D, Catanzaro B, Andrew N (2013) Deep learning with cots hpc systems. In: International Conference on Machine Learning, pp 1337\u20131345 (2013). PMLR"},{"key":"4555_CR31","volume-title":"High performance computing: modern systems and practices","author":"T Sterling","year":"2017","unstructured":"Sterling T, Brodowicz M, Anderson M (2017) High performance computing: modern systems and practices. Morgan Kaufmann, San Fransisco, California, USA"},{"issue":"1","key":"4555_CR32","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1109\/99.660313","volume":"5","author":"L Dagum","year":"1998","unstructured":"Dagum L, Menon R (1998) Openmp: an industry standard api for shared-memory programming. IEEE Comput Sci Eng 5(1):46\u201355","journal-title":"IEEE Comput Sci Eng"},{"key":"4555_CR33","unstructured":"Forum MPI (2021) MPI: A Message-Passing Interface Standard Version 4.0."},{"key":"4555_CR34","doi-asserted-by":"crossref","unstructured":"Khan A, Sim H, Vazhkudai SS, Butt AR, Kim Y. (2021) An analysis of system balance and architectural trends based on top500 supercomputers. In: The International Conference on High Performance Computing in Asia-Pacific Region, pp 11\u201322","DOI":"10.1145\/3432261.3432263"},{"issue":"5","key":"4555_CR35","doi-asserted-by":"publisher","first-page":"879","DOI":"10.1109\/JPROC.2008.917757","volume":"96","author":"JD Owens","year":"2008","unstructured":"Owens JD, Houston M, Luebke D, Green S, Stone JE, Phillips JC (2008) Gpu computing. Proc IEEE 96(5):879\u2013899","journal-title":"Proc IEEE"},{"key":"4555_CR36","volume-title":"OpenCL programming guide","author":"A Munshi","year":"2011","unstructured":"Munshi A, Gaster B, Mattson TG, Ginsburg D (2011) OpenCL programming guide. Pearson Education, Boston, MA, USA"},{"key":"4555_CR37","volume-title":"Parallel programming with OpenACC","author":"R Farber","year":"2016","unstructured":"Farber R (2016) Parallel programming with OpenACC. Newnes, Cambridge, MA, USA"},{"key":"4555_CR38","doi-asserted-by":"publisher","first-page":"146719","DOI":"10.1109\/ACCESS.2020.3012084","volume":"8","author":"A Podobas","year":"2020","unstructured":"Podobas A, Sano K, Matsuoka S (2020) A survey on coarse-grained reconfigurable architectures from a performance perspective. IEEE Access 8:146719\u2013146743","journal-title":"IEEE Access"},{"issue":"4","key":"4555_CR39","doi-asserted-by":"publisher","first-page":"1109","DOI":"10.1007\/s00521-018-3761-1","volume":"32","author":"S Mittal","year":"2020","unstructured":"Mittal S (2020) A survey of fpga-based accelerators for convolutional neural networks. Neural Comput Appl 32(4):1109\u20131139","journal-title":"Neural Comput Appl"},{"key":"4555_CR40","doi-asserted-by":"crossref","unstructured":"Reuther A, Michaleas P, Jones M, Gadepally V, Samsi S, Kepner J (2020) Survey of machine learning accelerators. In: 2020 IEEE High Performance Extreme Computing Conference (HPEC), pp 1\u201312. IEEE","DOI":"10.1109\/HPEC43674.2020.9286149"},{"issue":"19","key":"4555_CR41","doi-asserted-by":"publisher","first-page":"4834","DOI":"10.1016\/j.ces.2007.05.022","volume":"63","author":"VM Zavala","year":"2008","unstructured":"Zavala VM, Laird CD, Biegler LT (2008) Interior-point decomposition approaches for parallel solution of large-scale nonlinear parameter estimation problems. Chem Eng Sci 63(19):4834\u20134845","journal-title":"Chem Eng Sci"},{"issue":"2","key":"4555_CR42","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1007\/s10287-008-0090-3","volume":"6","author":"J Gondzio","year":"2009","unstructured":"Gondzio J, Grothey A (2009) Exploiting structure in parallel implementation of interior point methods for optimization. CMS 6(2):135\u2013160","journal-title":"CMS"},{"key":"4555_CR43","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1016\/j.compchemeng.2014.09.013","volume":"71","author":"J Kang","year":"2014","unstructured":"Kang J, Cao Y, Word DP, Laird CD (2014) An interior-point method for efficient solution of block-structured nlp problems using an implicit schur-complement decomposition. Comput Chem Eng 71:563\u2013573","journal-title":"Comput Chem Eng"},{"key":"4555_CR44","doi-asserted-by":"crossref","unstructured":"Chiang N, Petra CG, Zavala VM (2014) Structured nonconvex optimization of large-scale energy systems using pips-nlp. In: 2014 Power Systems Computation Conference, pp 1\u20137. IEEE","DOI":"10.1109\/PSCC.2014.7038374"},{"key":"4555_CR45","doi-asserted-by":"crossref","unstructured":"Kang J, Chiang N, Laird CD, Zavala VM (2015) Nonlinear programming strategies on high-performance computers. In: 2015 54th IEEE Conference on Decision and Control (CDC), pp 4612\u20134620. IEEE","DOI":"10.1109\/CDC.2015.7402938"},{"key":"4555_CR46","doi-asserted-by":"crossref","unstructured":"Amestoy PR, Duff IS, L\u2019Excellent J-Y, Koster J (2000) Mumps: a general purpose distributed memory sparse solver. In: International Workshop on Applied Parallel Computing, pp 121\u2013130. Springer","DOI":"10.1007\/3-540-70734-4_16"},{"issue":"3","key":"4555_CR47","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1016\/j.future.2003.07.011","volume":"20","author":"O Schenk","year":"2004","unstructured":"Schenk O, G\u00e4rtner K (2004) Solving unsymmetric sparse systems of linear equations with pardiso. Futur Gener Comput Syst 20(3):475\u2013487","journal-title":"Futur Gener Comput Syst"},{"issue":"2","key":"4555_CR48","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1007\/s10589-006-9003-y","volume":"36","author":"O Schenk","year":"2007","unstructured":"Schenk O, W\u00e4chter A, Hagemann M (2007) Matching-based preprocessing algorithms to the solution of saddle-point problems in large-scale nonconvex interior-point optimization. Comput Optim Appl 36(2):321\u2013341","journal-title":"Comput Optim Appl"},{"key":"4555_CR49","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1142\/9789812709356_0005","volume":"8","author":"IS Duff","year":"2006","unstructured":"Duff IS (2006) Sparse system solution and the hsl library. Some Topics Ind Appl Math 8:78\u201394","journal-title":"Some Topics Ind Appl Math"},{"issue":"1","key":"4555_CR50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2756548","volume":"42","author":"JD Hogg","year":"2016","unstructured":"Hogg JD, Ovtchinnikov E, Scott JA (2016) A sparse symmetric indefinite direct solver for gpu architectures. ACM Tran Math Softw(TOMS) 42(1):1\u201325","journal-title":"ACM Tran Math Softw(TOMS)"},{"key":"4555_CR51","unstructured":"Tasseff B, Coffrin C, W\u00e4chter A, Laird C (2019) Exploring benefits of linear solver parallelism on modern nonlinear optimization applications. arXiv preprint arXiv:1909.08104"},{"issue":"2","key":"4555_CR52","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1137\/18M1225963","volume":"42","author":"I Duff","year":"2020","unstructured":"Duff I, Hogg J, Lopez F (2020) A new sparse ldl\u2019t solver using a posteriori threshold pivoting. SIAM J Sci Comput 42(2):23\u201342","journal-title":"SIAM J Sci Comput"},{"issue":"1\u20132","key":"4555_CR53","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1002\/nla.310","volume":"10","author":"O Axelsson","year":"2003","unstructured":"Axelsson O, Neytcheva M (2003) Preconditioning methods for linear systems arising in constrained optimization problems. Numerical Linear Algebra Appl 10(1\u20132):3\u201331","journal-title":"Numerical Linear Algebra Appl"},{"issue":"4\u20135","key":"4555_CR54","doi-asserted-by":"publisher","first-page":"569","DOI":"10.1080\/10556780500140508","volume":"20","author":"L Luk\u0161an","year":"2005","unstructured":"Luk\u0161an L, Matonoha C, Vl\u010dek J (2005) Interior point methods for large-scale nonlinear programming. Opt Methods Softw 20(4\u20135):569\u2013582","journal-title":"Opt Methods Softw"},{"issue":"2","key":"4555_CR55","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1023\/B:COAP.0000026882.34332.1b","volume":"28","author":"L Bergamaschi","year":"2004","unstructured":"Bergamaschi L, Gondzio J, Zilli G (2004) Preconditioning indefinite systems in interior point methods for optimization. Comput Optim Appl 28(2):149\u2013171","journal-title":"Comput Optim Appl"},{"issue":"2","key":"4555_CR56","doi-asserted-by":"publisher","first-page":"666","DOI":"10.1137\/060650210","volume":"18","author":"A Forsgren","year":"2007","unstructured":"Forsgren A, Gill PE, Griffin JD (2007) Iterative solution of augmented systems arising in interior methods. SIAM J Optim 18(2):666\u2013690","journal-title":"SIAM J Optim"},{"issue":"6","key":"4555_CR57","doi-asserted-by":"publisher","first-page":"3447","DOI":"10.1137\/090747634","volume":"32","author":"FE Curtis","year":"2010","unstructured":"Curtis FE, Schenk O, W\u00e4chter A (2010) An interior-point algorithm for large-scale nonlinear optimization with inexact step computations. SIAM J Sci Comput 32(6):3447\u20133475","journal-title":"SIAM J Sci Comput"},{"issue":"2","key":"4555_CR58","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1007\/s10589-010-9361-3","volume":"51","author":"J Gondzio","year":"2012","unstructured":"Gondzio J (2012) Matrix-free interior point method. Comput Optim Appl 51(2):457\u2013480","journal-title":"Comput Optim Appl"},{"issue":"1","key":"4555_CR59","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1007\/s10107-012-0557-4","volume":"136","author":"FE Curtis","year":"2012","unstructured":"Curtis FE, Huber J, Schenk O, W\u00e4chter A (2012) A note on the implementation of an interior-point algorithm for nonlinear optimization with inexact step computations. Math Program 136(1):209\u2013227","journal-title":"Math Program"},{"issue":"3","key":"4555_CR60","doi-asserted-by":"publisher","first-page":"1251","DOI":"10.1137\/130921283","volume":"36","author":"MJ Grote","year":"2014","unstructured":"Grote MJ, Huber J, Kourounis D, Schenk O (2014) Inexact interior-point method for pde-constrained nonlinear optimization. SIAM J Sci Comput 36(3):1251\u20131276","journal-title":"SIAM J Sci Comput"},{"key":"4555_CR61","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1016\/j.compchemeng.2015.10.010","volume":"85","author":"Y Cao","year":"2016","unstructured":"Cao Y, Seth A, Laird CD (2016) An augmented lagrangian interior-point approach for large-scale nlp problems on graphics processing units. Comput Chem Eng 85:76\u201383","journal-title":"Comput Chem Eng"},{"key":"4555_CR62","first-page":"102870","volume":"11","author":"K \u015awirydowicz","year":"2021","unstructured":"\u015awirydowicz K, Darve E, Jones W, Maack J, Regev S, Saunders MA, Thomas SJ, Pele\u0161 S (2021) Linear solvers for power grid optimization problems: a review of gpu-accelerated linear solvers. Parallel Comput 11:102870","journal-title":"Parallel Comput"},{"key":"4555_CR63","unstructured":"Regev S, Chiang NY, Darve E, Petra CG, Saunders MA (2011) A hybrid direct-iterative method for solving kkt linear systems. arXiv preprint arXiv:2110.03636"},{"key":"4555_CR64","unstructured":"Geffken S, B\u00fcskens C (2016) Worhp multi-core interface, parallelisation approaches for an nlp solver. In: Proceedings of the 6th International Conference on Astrodynamics Tools and Techniques, 2016-03-14 - 2016-03-17, Darmstadt, Germany"},{"key":"4555_CR65","doi-asserted-by":"crossref","unstructured":"Hu X, Douglas CC, Lumley R, Seo M (2017) Gpu accelerated sequential quadratic programming. In: 2017 16th International Symposium on Distributed Computing and Applications to Business, Engineering and Science (DCABES), pp. 3\u20136. IEEE","DOI":"10.1109\/DCABES.2017.8"},{"key":"4555_CR66","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780198508380.001.0001","volume-title":"Direct methods for sparse matrices","author":"IS Duff","year":"2017","unstructured":"Duff IS, Erisman AM, Reid JK (2017) Direct methods for sparse matrices. Oxford University Press, Oxford"},{"key":"4555_CR67","unstructured":"Gupta A, Joshi M, Kumar V (2001) Wsmp: a high-performance shared and distributed-memory parallel sparse linear equation solver. IBM Research Division RC, 22038"},{"issue":"3","key":"4555_CR68","doi-asserted-by":"publisher","first-page":"545","DOI":"10.1007\/s10589-014-9687-3","volume":"60","author":"NI Gould","year":"2015","unstructured":"Gould NI, Orban D, Toint PL (2015) Cutest: a constrained and unconstrained testing environment with safe threads for mathematical optimization. Comput Optim Appl 60(3):545\u2013557","journal-title":"Comput Optim Appl"},{"issue":"2","key":"4555_CR69","doi-asserted-by":"publisher","first-page":"460","DOI":"10.1137\/0915031","volume":"15","author":"C Pommerell","year":"1994","unstructured":"Pommerell C, Fichtner W (1994) Memory aspects and performance of iterative solvers. SIAM J Sci Comput 15(2):460\u2013473","journal-title":"SIAM J Sci Comput"},{"issue":"4","key":"4555_CR70","doi-asserted-by":"publisher","first-page":"801","DOI":"10.1002\/nme.1620280406","volume":"28","author":"G Brussino","year":"1989","unstructured":"Brussino G, Sonnad V (1989) A comparison of direct and preconditioned iterative techniques for sparse, unsymmetric systems of linear equations. Int J Numer Meth Eng 28(4):801\u2013815","journal-title":"Int J Numer Meth Eng"},{"issue":"4","key":"4555_CR71","doi-asserted-by":"publisher","first-page":"1300","DOI":"10.1137\/S0895479899351805","volume":"21","author":"C Keller","year":"2000","unstructured":"Keller C, Gould NI, Wathen AJ (2000) Constraint preconditioning for indefinite linear systems. SIAM J Matrix Anal Appl 21(4):1300\u20131317","journal-title":"SIAM J Matrix Anal Appl"},{"key":"4555_CR72","doi-asserted-by":"crossref","unstructured":"Dolan ED, Mor\u00e9 JJ, Munson TS (2004) Benchmarking optimization software with cops 3.0. Technical report, Argonne National Lab., Argonne, IL (US)","DOI":"10.2172\/834714"},{"key":"4555_CR73","unstructured":"cuSOLVER Reference Guide. https:\/\/docs.nvidia.com\/cuda\/cusolver\/index.html. Accessed: 2022-02-02"},{"issue":"1","key":"4555_CR74","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1007\/s10107-004-0559-y","volume":"106","author":"A W\u00e4chter","year":"2006","unstructured":"W\u00e4chter A, Biegler LT (2006) On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming. Math Program 106(1):25\u201357","journal-title":"Math Program"},{"key":"4555_CR75","doi-asserted-by":"crossref","unstructured":"Balay S, Gropp WD, McInnes LC, Smith BF (1997) Efficient management of parallelism in object oriented numerical software libraries. In: Modern Software Tools in Scientific Computing, pp. 163\u2013202. Birkh\u00e4user Boston, Boston, MA","DOI":"10.1007\/978-1-4612-1986-6_8"},{"issue":"9","key":"4555_CR76","doi-asserted-by":"publisher","first-page":"1124","DOI":"10.1016\/j.advwatres.2011.04.013","volume":"34","author":"LD Dalcin","year":"2011","unstructured":"Dalcin LD, Paz RR, Kler PA, Cosimo A (2011) Parallel distributed computing using python. Adv Water Resour 34(9):1124\u20131139","journal-title":"Adv Water Resour"},{"key":"4555_CR77","doi-asserted-by":"crossref","unstructured":"Balay S, Abhyankar S, Adams MF, Benson S, Brown J, Brune P, Buschelman K, Constantinescu E, Dalcin L, Dener A, Eijkhout V (2021) PETSc\/TAO users manual. Technical Report ANL-21\/39 - Revision 3.16, Argonne National Laboratory","DOI":"10.2172\/1893326"},{"issue":"2","key":"4555_CR78","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1145\/779359.779361","volume":"29","author":"XS Li","year":"2003","unstructured":"Li XS, Demmel JW (2003) Superlu_dist: a scalable distributed-memory sparse direct solver for unsymmetric linear systems. ACM Trans Math Softw(TOMS) 29(2):110\u2013140","journal-title":"ACM Trans Math Softw(TOMS)"},{"key":"4555_CR79","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1016\/j.jpdc.2018.10.009","volume":"133","author":"CG Petra","year":"2019","unstructured":"Petra CG (2019) A memory-distributed quasi-newton solver for nonlinear programming problems with a small number of general constraints. J Parallel Distrib Comput 133:337\u2013348","journal-title":"J Parallel Distrib Comput"},{"key":"4555_CR80","unstructured":"Peles S, Perumalla M, Alam M, Mancinelli AJ, Rutherford RC, Ryan J, Petra CG (2021)Porting the nonlinear optimization library hiop to accelerator-based hardware architectures. Manuscript submitted for publication"},{"key":"4555_CR81","doi-asserted-by":"crossref","unstructured":"Beckingsale DA, Burmark J, Hornung R, Jones H, Killian W, Kunen AJ, Pearce O, Robinson P, Ryujin BS, Scogland TR (2019) Raja: Portable performance for large-scale scientific applications. In: 2019 Ieee\/acm International Workshop on Performance, Portability and Productivity in Hpc (p3hpc), pp 71\u201381. IEEE","DOI":"10.1109\/P3HPC49587.2019.00012"},{"key":"4555_CR82","unstructured":"Petra CG, Chiang N-Y (2021) Hiop - user guide version 0.5. Technical Report LLNL-SM-743591, Lawrence Livermore National Laboratory. Accessed 2021-10-07. https:\/\/github.com\/LLNL\/hiop\/blob\/develop\/doc\/hiop_usermanual.pdf"},{"key":"4555_CR83","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1016\/j.apenergy.2016.01.017","volume":"168","author":"N-Y Chiang","year":"2016","unstructured":"Chiang N-Y, Zavala VM (2016) Large-scale optimal control of interconnected natural gas and electrical transmission systems. Appl Energy 168:226\u2013235","journal-title":"Appl Energy"},{"issue":"3","key":"4555_CR84","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1007\/s10107-003-0379-5","volume":"96","author":"J Gondzio","year":"2003","unstructured":"Gondzio J, Sarkissian R (2003) Parallel interior-point solver for structured linear programs. Math Program 96(3):561\u2013584","journal-title":"Math Program"},{"key":"4555_CR85","unstructured":"Grothey A, Hogg J, Woodsend K, Colombo M, Gondzio J (2009) A structure conveying parallelizable modeling language for mathematical programming. In: Parallel Scientific Computing and Optimization. Springer. New York, NY, USA"},{"key":"4555_CR86","first-page":"43","volume":"21","author":"J Gondzio","year":"2006","unstructured":"Gondzio J, Grothey A (2006) Solving nonlinear financial planning problems with 109 decision variables on massively parallel architectures. WIT Trans Model Simul 21:43","journal-title":"WIT Trans Model Simul"},{"key":"4555_CR87","unstructured":"Wassel D (2013) Exploring novel designs of nlp solvers: architecture and implementation of worhp. PhD thesis, Universit\u00e4t Bremen"},{"key":"4555_CR88","doi-asserted-by":"crossref","unstructured":"Byrd RH, Nocedal J, Waltz RA (2006) Knitro: An integrated package for nonlinear optimization. In: Large-scale Nonlinear Optimization, pp. 35\u201359. Springer, New York","DOI":"10.1007\/0-387-30065-1_4"},{"key":"4555_CR89","unstructured":"Artelys Knitro User\u2019s Manual. https:\/\/www.artelys.com\/docs\/knitro\/. Accessed: 2022-02-01"},{"issue":"3","key":"4555_CR90","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1007\/s10107-004-0560-5","volume":"107","author":"RA Waltz","year":"2006","unstructured":"Waltz RA, Morales JL, Nocedal J, Orban D (2006) An interior algorithm for nonlinear optimization that combines line search and trust region steps. Math Program 107(3):391\u2013408","journal-title":"Math Program"},{"issue":"4","key":"4555_CR91","doi-asserted-by":"publisher","first-page":"877","DOI":"10.1137\/S1052623497325107","volume":"9","author":"RH Byrd","year":"1999","unstructured":"Byrd RH, Hribar ME, Nocedal J (1999) An interior point algorithm for large-scale nonlinear programming. SIAM J Optim 9(4):877\u2013900","journal-title":"SIAM J Optim"},{"issue":"1","key":"4555_CR92","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1007\/s10107-003-0485-4","volume":"100","author":"RH Byrd","year":"2003","unstructured":"Byrd RH, Gould NI, Nocedal J, Waltz RA (2003) An algorithm for nonlinear optimization using linear programming and equality constrained subproblems. Math Program 100(1):27\u201348","journal-title":"Math Program"},{"issue":"1","key":"4555_CR93","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1137\/S0036144504446096","volume":"47","author":"PE Gill","year":"2005","unstructured":"Gill PE, Murray W, Saunders MA (2005) Snopt: An sqp algorithm for large-scale constrained optimization. SIAM Rev 47(1):99\u2013131","journal-title":"SIAM Rev"},{"key":"4555_CR94","unstructured":"Gill PE, Murray W, Saunders MA, Wong E (2018) User\u2019s guide for sqopt 7.7: Software for large-scale linear and quadratic programming. Department of Mathematics, University of California, San Diego, La Jolla, CA, Center for Computational Mathematics Report CCoM, 18\u20132"},{"key":"4555_CR95","unstructured":"Gill, P.E., Murray, W., Saunders, M.A., Wong, E.: User\u2019s guide for SNOPT 7.7: Software for large-scale nonlinear programming. Center for Computational Mathematics Report CCoM 18-1, Department of Mathematics, University of California, San Diego, La Jolla, CA (2018)"},{"key":"4555_CR96","unstructured":"GAMS User\u2019s Guide. https:\/\/www.gams.com\/latest\/docs\/UG_MAIN.html. Accessed: 2022-02-02"},{"issue":"5","key":"4555_CR97","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1287\/mnsc.36.5.519","volume":"36","author":"R Fourer","year":"1990","unstructured":"Fourer R, Gay DM, Kernighan BW (1990) A modeling language for mathematical programming. Manage Sci 36(5):519\u2013554","journal-title":"Manage Sci"},{"key":"4555_CR98","unstructured":"Makhorin A (2000) Modeling language gnu mathprog. Relat\u00f3rio T\u00e9cnico, Moscow Aviation Institute, 63"},{"key":"4555_CR99","unstructured":"Bisschop JJ (2022) AIMMS - Optimization Modeling. AIMMS B.V., 2006. AIMMS B.V.. Available at: https:\/\/documentation.aimms.com\/_downloads\/AIMMS_modeling.pdf"},{"key":"4555_CR100","doi-asserted-by":"crossref","unstructured":"Lau MS, Yue S-P, Ling KV, Maciejowski JM (2009) A comparison of interior point and active set methods for fpga implementation of model predictive control. In: 2009 European Control Conference (ECC), pp. 156\u2013161. IEEE","DOI":"10.23919\/ECC.2009.7074396"},{"issue":"9","key":"4555_CR101","first-page":"625","volume":"3","author":"M Cerezo","year":"2021","unstructured":"Cerezo M, Arrasmith A, Babbush R, Benjamin SC, Endo S, Fujii K, McClean JR, Mitarai K, Yuan X, Cincio L et al (2021) Variational quantum algorithms. Nature Reviews. Physics 3(9):625\u2013644","journal-title":"Physics"},{"issue":"1","key":"4555_CR102","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.101.010301","volume":"101","author":"M Lubasch","year":"2020","unstructured":"Lubasch M, Joo J, Moinier P, Kiffner M, Jaksch D (2020) Variational quantum algorithms for nonlinear problems. Phys Rev A 101(1):010301","journal-title":"Phys Rev A"},{"issue":"5","key":"4555_CR103","doi-asserted-by":"publisher","first-page":"052416","DOI":"10.1103\/PhysRevA.103.052416","volume":"103","author":"O Kyriienko","year":"2021","unstructured":"Kyriienko O, Paine AE, Elfving VE (2021) Solving nonlinear differential equations with differentiable quantum circuits. Phys Rev A 103(5):052416","journal-title":"Phys Rev A"}],"container-title":["The Journal of Supercomputing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11227-022-04555-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11227-022-04555-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11227-022-04555-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,10]],"date-time":"2023-01-10T10:11:35Z","timestamp":1673345495000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11227-022-04555-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,20]]},"references-count":103,"journal-issue":{"issue":"16","published-print":{"date-parts":[[2022,11]]}},"alternative-id":["4555"],"URL":"https:\/\/doi.org\/10.1007\/s11227-022-04555-8","relation":{},"ISSN":["0920-8542","1573-0484"],"issn-type":[{"value":"0920-8542","type":"print"},{"value":"1573-0484","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,20]]},"assertion":[{"value":"20 April 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 May 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}