{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:33:57Z","timestamp":1760236437043,"version":"build-2065373602"},"reference-count":54,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2021,11,26]],"date-time":"2021-11-26T00:00:00Z","timestamp":1637884800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Mathematics"],"abstract":"<jats:p>We propose a stochastic algorithm for global optimisation of a regular function, possibly unbounded, defined on a bounded set with regular boundary; a function that attains its extremum in the boundary of its domain of definition. The algorithm is determined by a diffusion process that is associated with the function by means of a strictly elliptic operator that ensures an adequate maximum principle. In order to preclude the algorithm to be trapped in a local extremum, we add a pure random search step to the algorithm. We show that an adequate procedure of parallelisation of the algorithm can increase the rate of convergence, thus superseding the main drawback of the addition of the pure random search step.<\/jats:p>","DOI":"10.3390\/math9233043","type":"journal-article","created":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T05:42:10Z","timestamp":1638250930000},"page":"3043","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["On a Parallelised Diffusion Induced Stochastic Algorithm with Pure Random Search Steps for Global Optimisation"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4991-7568","authenticated-orcid":false,"given":"Manuel L.","family":"Esqu\u00edvel","sequence":"first","affiliation":[{"name":"Department of Mathematics, Centre for Mathematics and Applications, NOVA School of Science and Technology, New University of Lisbon, 2829-516 Caparica, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4226-1658","authenticated-orcid":false,"given":"Nadezhda P.","family":"Krasii","sequence":"additional","affiliation":[{"name":"Department of Higher Mathematics, Faculty of Informatics and Computer Engineering, Don State Technical University, 344003 Rostov-on-Don, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5644-3551","authenticated-orcid":false,"given":"Pedro P.","family":"Mota","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Centre for Mathematics and Applications, NOVA School of Science and Technology, New University of Lisbon, 2829-516 Caparica, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3129-6436","authenticated-orcid":false,"given":"N\u00e9lio","family":"Machado","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Faculty of Science and Technology, New University of Lisbon, 2829-516 Caparica, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zabinsky, Z.B. (2003). Stochastic Adaptive Search for Global Optimization; Nonconvex Optimization and its Applications, Kluwer Academic Publishers.","DOI":"10.1007\/978-1-4419-9182-9"},{"key":"ref_2","unstructured":"Spall, J.C. (2004). Stochastic optimization. Handbook of Computational Statistics, Springer."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Rubinstein, R.Y., and Kroese, D.P. (2008). Simulation and the Monte Carlo Method, Wiley-Interscience [John Wiley & Sons]. [2nd ed.].","DOI":"10.1002\/9780470230381"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"841","DOI":"10.1007\/11751595_89","article-title":"A conditional Gaussian martingale algorithm for global optimization","volume":"Volume 3982","author":"Gavrilova","year":"2006","journal-title":"Computational Science and Its Applications\u2014ICCSA 2006, PT 3"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1023\/A:1022612511618","article-title":"Global optimization requires global information","volume":"96","author":"Stephens","year":"1998","journal-title":"J. Optim. Theory Appl."},{"key":"ref_6","unstructured":"Albert, N.S., Konstantin, E.S., and Dmitry, V.K. (2021). On the Information Content of some Stochastic Algorithms. Recent Developments in Stochastic Methods and Applications, Springer International Publishing. Springer Proceedings in Mathematics & Statistics."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Spall, J.C. (2003). Introduction to Stochastic Search and Optimization, Wiley-Interscience [John Wiley & Sons].","DOI":"10.1002\/0471722138"},{"key":"ref_8","unstructured":"Duflo, M. (1996). Algorithmes Stochastiques, Springer. Math\u00e9matiques & Applications (Berlin) [Mathematics & Applications]."},{"key":"ref_9","unstructured":"Stephen, S.W. (1997). Random Iterative Models; Applications of Mathematics (New York), Springer."},{"key":"ref_10","unstructured":"Albrecht, A., and Steinh\u00f6fel, K. (2003). Global Optimization\u2014Stochastic or Deterministic?. Stochastic Algorithms: Foundations and Applications, Springer."},{"key":"ref_11","unstructured":"Zhigljavsky, A., and \u017dilinskas, A. (2008). Stochastic Global Optimization, Springer. Springer Optimization and Its Applications."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"22924","DOI":"10.1073\/pnas.1908018116","article-title":"The importance of better models in stochastic optimization","volume":"116","author":"Asi","year":"2019","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Plevris, V., Bakas, N.P., and Solorzano, G. (2021). Pure Random Orthogonal Search (PROS): A Plain and Elegant Parameterless Algorithm for Global Optimization. Appl. Sci., 11.","DOI":"10.3390\/app11115053"},{"key":"ref_14","first-page":"137","article-title":"L2 environmental indexes","volume":"36","author":"Mexia","year":"1999","journal-title":"Listy Biom."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1080\/00949650802546784","article-title":"Comparing double minimization and zigzag algorithms in joint regression analysis: The complete case","volume":"80","author":"Pereira","year":"2010","journal-title":"J. Stat. Comput. Simul."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1239\/aap\/1013540175","article-title":"Convergence of a global stochastic optimization algorithm with partial step size restarting","volume":"32","author":"Yin","year":"2000","journal-title":"Adv. Appl. Probab."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1111\/j.1751-5823.2002.tb00174.x","article-title":"Stochastic Optimization: A Review","volume":"70","author":"Fouskakis","year":"2002","journal-title":"Int. Stat. Rev.\/Rev. Int. De Stat."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1007\/s11741-000-0002-4","article-title":"Improvement of pure random search in global optimization","volume":"4","author":"Peng","year":"2000","journal-title":"J. Shanghai Univ."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kushner, H.J., and Clark, D.S. (1978). Stochastic Approximation Methods for Constrained and Unconstrained Systems, Springer. Applied Mathematical Sciences.","DOI":"10.1007\/978-1-4684-9352-8"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/BF00941312","article-title":"Global optimization and stochastic differential equations","volume":"47","author":"Parisi","year":"1985","journal-title":"J. Optim. Theory Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1137\/0325042","article-title":"Diffusion for global optimization in Rn","volume":"25","author":"Chiang","year":"1987","journal-title":"Siam J. Control Optim."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1145\/50063.50064","article-title":"A global optimization algorithm using stochastic differential equations","volume":"14","author":"Parisi","year":"1988","journal-title":"ACM Trans. Math. Softw."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1080\/00207168808803626","article-title":"A numerical study of some modified versions of controlled random search method for global optimization","volume":"23","author":"Mohan","year":"1988","journal-title":"Int. J. Comput. Math."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1007\/s10898-006-9026-z","article-title":"Linearly constrained global optimization and stochastic differential equations","volume":"36","author":"Parpas","year":"2006","journal-title":"J. Glob. Optim."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/s10898-008-9397-4","article-title":"Convergence analysis of a global optimization algorithm using stochastic differential equations","volume":"45","author":"Parpas","year":"2009","journal-title":"J. Glob. Optim."},{"key":"ref_26","first-page":"6235","article-title":"Unconstrained real valued optimization based on stochastic differential equations","volume":"7","author":"Vegh","year":"2011","journal-title":"Int. J. Innov. Comput. Inf. Control"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Glasserman, P. (2004). Monte Carlo Methods in Financial Engineering, Springer. Applications of Mathematics (New York); Stochastic Modelling and Applied Probability.","DOI":"10.1007\/978-0-387-21617-1"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1137\/S1052623497319225","article-title":"Rates of convergence for a class of global stochastic optimization algorithms","volume":"10","author":"Yin","year":"1999","journal-title":"Siam J. Optim."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kontoghiorghes, E.J. (2006). Handbook of Parallel Computing and Statistics, Chapman & Hall\/CRC. Statistics: Textbooks and Monographs.","DOI":"10.1201\/9781420028683"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Rajasekaran, S., and Reif, J. (2008). Handbook of Parallel Computing: Models, Algorithms and Applications, CRC Press.","DOI":"10.1201\/9781420011296"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hamadi, Y., and Sais, L. (2018). Handbook of Parallel Constraint Reasoning, Springer.","DOI":"10.1007\/978-3-319-63516-3"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1007\/BF00939049","article-title":"Global optimization algorithms for a CAD workstation","volume":"55","author":"Price","year":"1987","journal-title":"J. Optim. Theory Appl."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1007\/s10732-015-9292-3","article-title":"Estimating parallel runtimes for randomized algorithms in constraint solving","volume":"22","author":"Truchet","year":"2016","journal-title":"J. Heuristics"},{"key":"ref_34","unstructured":"Chamberlain, R., Edelman, M., Franklin, M., and Witte, E. (1988, January 3\u20135). Simulated annealing on a multiprocessor. Proceedings of the 1988 IEEE International Conference on Computer Design: VLSI, Rye Brook, NY, USA."},{"key":"ref_35","unstructured":"Azencott, R. (1992). Parallel simulated annealing: An overview of basic techniques. Simulated Annealing, Wiley."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1023\/A:1008350810199","article-title":"Parallel simulated annealing algorithms in global optimization","volume":"19","year":"2001","journal-title":"J. Glob. Optim."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wyrzykowski, R., Dongarra, J., Paprzycki, M., and Wa\u015bniewski, J. (2002). Three Parallel Algorithms for Simulated Annealing. Parallel Processing and Applied Mathematics, Springer.","DOI":"10.1007\/3-540-48086-2"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/s10898-007-9138-0","article-title":"Parallelizing simulated annealing algorithms based on high-performance computer","volume":"39","author":"Chen","year":"2007","journal-title":"J. Glob. Optim."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.parco.2016.02.001","article-title":"Parallel simulated annealing using an adaptive resampling interval","volume":"53","author":"Lou","year":"2016","journal-title":"Parallel Comput."},{"key":"ref_40","unstructured":"Genet, J. (1976). Mesure et Int\u00e9gration, Librairie Vuibert."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Kopp, P.E. (1984). Martingales and Stochastic Integrals, Cambridge University Press.","DOI":"10.1017\/CBO9780511897221"},{"key":"ref_42","unstructured":"Dudley, R.M. (2002). Real Analysis and Probability, Cambridge University Press. Cambridge Studies in Advanced Mathematics; Revised Reprint of the 1989 Original."},{"key":"ref_43","unstructured":"Pacheco, P.S., and Malensek, M. (2022). An Introduction to Parallel Programming, Morgan Kaufmann Publishers; Elsevier. [2nd ed.]."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1145\/42411.42415","article-title":"Reevaluating Amdahl\u2019s Law","volume":"31","author":"Gustafson","year":"1988","journal-title":"Commun. ACM"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"McKean, H.P. (2005). Stochastic Integrals, AMS Chelsea Publishing. Reprint of the 1969 Edition, with Errata.","DOI":"10.1090\/chel\/353"},{"key":"ref_46","unstructured":"Bass, R.F. (1998). Diffusions and Elliptic Operators, Springer. Probability and Its Applications (New York)."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Bass, R.F. (2011). Stochastic Processes, Cambridge University Press.","DOI":"10.1017\/CBO9780511997044"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Kloeden, P.E., and Platen, E. (1992). Numerical Solution of Stochastic Differential Equations, Springer. Applications of Mathematics (New York).","DOI":"10.1007\/978-3-662-12616-5"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Korn, R., Korn, E., and Kroisandt, G. (2010). Monte Carlo Methods and Models in Finance and Insurance, CRC Press.","DOI":"10.1201\/9781420076196"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Prokhorov, Y.V., and Shiryaev, A.N. (1998). Probability Theory III: Stochastic Calculus, Springer. Encyclopaedia of Mathematical Sciences, Volume 45.","DOI":"10.1007\/978-3-662-03640-2"},{"key":"ref_51","unstructured":"Wolfram Research, Inc. (2021). Mathematica, Version 12.3.1, Wolfram Research, Inc."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Daniele, C., Da Vi\u00e0, R., Manservisi, S., and Zunino, P. (2020). A multiscale heat transfer model for nuclear reactor assemblies. Nucl. Eng. Des., 367.","DOI":"10.1016\/j.nucengdes.2020.110794"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1145\/355934.355936","article-title":"Testing Unconstrained Optimization Software","volume":"7","author":"Garbow","year":"1981","journal-title":"ACM Trans. Math. Softw."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1137\/S105262340240063X","article-title":"On Accelerated Random Search","volume":"14","author":"Appel","year":"2004","journal-title":"SIAM J. Optim."}],"container-title":["Mathematics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-7390\/9\/23\/3043\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:36:28Z","timestamp":1760168188000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-7390\/9\/23\/3043"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,26]]},"references-count":54,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["math9233043"],"URL":"https:\/\/doi.org\/10.3390\/math9233043","relation":{},"ISSN":["2227-7390"],"issn-type":[{"type":"electronic","value":"2227-7390"}],"subject":[],"published":{"date-parts":[[2021,11,26]]}}}