{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T03:23:40Z","timestamp":1771039420621,"version":"3.50.1"},"reference-count":39,"publisher":"MIT Press","issue":"4","license":[{"start":{"date-parts":[[2023,5,1]],"date-time":"2023-05-01T00:00:00Z","timestamp":1682899200000},"content-version":"vor","delay-in-days":120,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>For offline data-driven multiobjective optimization problems (MOPs), no new data is available during the optimization process. Approximation models (or surrogates) are first built using the provided offline data, and an optimizer, for example, a multiobjective evolutionary algorithm, can then be utilized to find Pareto optimal solutions to the problem with surrogates as objective functions. In contrast to online data-driven MOPs, these surrogates cannot be updated with new data and, hence, the approximation accuracy cannot be improved by considering new data during the optimization process. Gaussian process regression (GPR) models are widely used as surrogates because of their ability to provide uncertainty information. However, building GPRs becomes computationally expensive when the size of the dataset is large. Using sparse GPRs reduces the computational cost of building the surrogates. However, sparse GPRs are not tailored to solve offline data-driven MOPs, where good accuracy of the surrogates is needed near Pareto optimal solutions. Treed GPR (TGPR-MO) surrogates for offline data-driven MOPs with continuous decision variables are proposed in this paper. The proposed surrogates first split the decision space into subregions using regression trees and build GPRs sequentially in regions close to Pareto optimal solutions in the decision space to accurately approximate tradeoffs between the objective functions. TGPR-MO surrogates are computationally inexpensive because GPRs are built only in a smaller region of the decision space utilizing a subset of the data. The TGPR-MO surrogates were tested on distance-based visualizable problems with various data sizes, sampling strategies, numbers of objective functions, and decision variables. Experimental results showed that the TGPR-MO surrogates are computationally cheaper and can handle datasets of large size. Furthermore, TGPR-MO surrogates produced solutions closer to Pareto optimal solutions compared to full GPRs and sparse GPRs.<\/jats:p>","DOI":"10.1162\/evco_a_00329","type":"journal-article","created":{"date-parts":[[2023,5,1]],"date-time":"2023-05-01T18:06:54Z","timestamp":1682964414000},"page":"375-399","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":4,"title":["Treed Gaussian Process Regression for Solving Offline Data-Driven Continuous Multiobjective Optimization Problems"],"prefix":"10.1162","volume":"31","author":[{"given":"Atanu","family":"Mazumdar","sequence":"first","affiliation":[{"name":"University of Jyvaskyla, Faculty of Information Technology, Finland atanu.a.mazumdar@jyu.fi"}]},{"given":"Manuel","family":"L\u00f3pez-Ib\u00e1\u00f1ez","sequence":"additional","affiliation":[{"name":"Alliance Manchester Business School, University of Manchester, UK manuel.lopez-ibanez@manchester.ac.uk"}]},{"given":"Tinkle","family":"Chugh","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Exeter, UK t.chugh@exeter.ac.uk"}]},{"given":"Jussi","family":"Hakanen","sequence":"additional","affiliation":[{"name":"University of Jyvaskyla, Faculty of Information Technology, Finland jussi.hakanen@jyu.fi"}]},{"given":"Kaisa","family":"Miettinen","sequence":"additional","affiliation":[{"name":"University of Jyvaskyla, Faculty of Information Technology, Finland kaisa.miettinen@jyu.fi"}]}],"member":"281","published-online":{"date-parts":[[2023,12,1]]},"reference":[{"key":"2023120113073297200_B1","article-title":"Heteroscedastic treed Bayesian optimisation","author":"Assael","year":"2014","journal-title":"CoRR"},{"key":"2023120113073297200_B2","doi-asserted-by":"publisher","first-page":"216","DOI":"10.1002\/widm.1157","article-title":"A survey on multi-output regression","volume":"5","author":"Borchani","year":"2015","journal-title":"WIREs Data Mining and Knowledge Discovery"},{"key":"2023120113073297200_B3","doi-asserted-by":"publisher","first-page":"919","DOI":"10.1029\/93JC02564","article-title":"Arctic sea ice variability: Model sensitivities and a multidecadal simulation","volume":"99","author":"Chapman","year":"1994","journal-title":"Journal of Geophysical Research: Oceans"},{"key":"2023120113073297200_B4","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1109\/TEVC.2016.2519378","article-title":"A reference vector guided evolutionary algorithm for many-objective optimization","volume":"20","author":"Cheng","year":"2016","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2023120113073297200_B5","doi-asserted-by":"publisher","first-page":"935","DOI":"10.1080\/01621459.1998.10473750","article-title":"Bayesian CART model search","volume":"93","author":"Chipman","year":"1998","journal-title":"Journal of the American Statistical Association"},{"key":"2023120113073297200_B6","doi-asserted-by":"publisher","first-page":"3137","DOI":"10.1007\/s00500-017-2965-0","article-title":"A survey on handling computationally expensive multiobjective optimization problems with evolutionary algorithms","volume":"23","author":"Chugh","year":"2019","journal-title":"Soft Computing"},{"key":"2023120113073297200_B7","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1109\/ICDM.2010.38","article-title":"Block-GP: Scalable Gaussian process regression for multimodal data","author":"Das","year":"2010","journal-title":"2010 IEEE International Conference on Data Mining"},{"key":"2023120113073297200_B8","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1109\/TEVC.2013.2281535","article-title":"An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, Part I: Solving problems with box constraints","volume":"18","author":"Deb","year":"2014","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2023120113073297200_B9","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1007\/1-84628-137-7_6","article-title":"Scalable test problems for evolutionary multiobjective optimization","volume-title":"Evolutionary multiobjective optimization: Theoretical advances and applications","author":"Deb","year":"2005"},{"key":"2023120113073297200_B10","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1109\/TEVC.2005.859463","article-title":"Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels","volume":"10","author":"Emmerich","year":"2006","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2023120113073297200_B11","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1145\/3321707.3321727","article-title":"A feature rich distance-based many-objective visualisable test problem generator","author":"Fieldsend","year":"2019","journal-title":"Proceedings of the Genetic and Evolutionary Computation Conference"},{"key":"2023120113073297200_B12","doi-asserted-by":"crossref","DOI":"10.1002\/9780470770801","volume-title":"Engineering design via surrogate modelling","author":"Forrester","year":"2008"},{"key":"2023120113073297200_B13","article-title":"GPy: A Gaussian process framework in Python","author":"GPy","year":"2012"},{"key":"2023120113073297200_B14","doi-asserted-by":"publisher","first-page":"1119","DOI":"10.1198\/016214508000000689","article-title":"Bayesian treed Gaussian process models with an application to computer modeling","volume":"103","author":"Gramacy","year":"2008","journal-title":"Journal of the American Statistical Association"},{"key":"2023120113073297200_B15","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1007\/3-540-44719-9_23","article-title":"Evolutionary multi-objective ranking with uncertainty and noise","author":"Hughes","year":"2001","journal-title":"Proceedings of Evolutionary Multi-Criterion Optimization"},{"key":"2023120113073297200_B16","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1109\/TEVC.2018.2869001","article-title":"Data-driven evolutionary optimization: An overview and case studies","volume":"23","author":"Jin","year":"2019","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2023120113073297200_B17","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1023\/A:1008306431147","article-title":"Efficient global optimization of expensive black-box functions","volume":"13","author":"Jones","year":"1998","journal-title":"Journal of Global Optimization"},{"key":"2023120113073297200_B18","doi-asserted-by":"publisher","first-page":"653","DOI":"10.1198\/016214504000002014","article-title":"Analyzing nonstationary spatial data using piecewise Gaussian processes","volume":"100","author":"Kim","year":"2005","journal-title":"Journal of the American Statistical Association"},{"key":"2023120113073297200_B19","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1002\/widm.8","article-title":"Classification and regression trees","volume":"1","author":"Loh","year":"2011","journal-title":"WIREs Data Mining and Knowledge Discovery"},{"key":"2023120113073297200_B20","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/978-3-030-63710-1_8","article-title":"An interactive framework for offline data-driven multiobjective optimization","author":"Mazumdar","year":"2020","journal-title":"Proceedings of Bioinspired Optimization Methods and Their Applications"},{"key":"2023120113073297200_B21","doi-asserted-by":"publisher","first-page":"1182","DOI":"10.1109\/TEVC.2022.3154231","article-title":"Probabilistic selection approaches in decomposition-based evolutionary algorithms for offline data-driven multiobjective optimization","volume":"26","author":"Mazumdar","year":"2022","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2023120113073297200_B22","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1007\/978-3-030-12598-1_37","article-title":"On dealing with uncertainties from Kriging models in offline data-driven evolutionary multiobjective optimization","author":"Mazumdar","year":"2019","journal-title":"Proceedings of Evolutionary Multi-Criterion Optimization"},{"key":"2023120113073297200_B23","doi-asserted-by":"publisher","first-page":"148277","DOI":"10.1109\/ACCESS.2021.3123825","article-title":"DESDEO: The modular and open source framework for interactive multiobjective optimization","volume":"9","author":"Misitano","year":"2021","journal-title":"IEEE Access"},{"key":"2023120113073297200_B24","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1007\/s10844-017-0462-7","article-title":"Tree-based methods for online multi-target regression","volume":"50","author":"Osojnik","year":"2018","journal-title":"Journal of Intelligent Information Systems"},{"key":"2023120113073297200_B25","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"2023120113073297200_B26","doi-asserted-by":"publisher","first-page":"446","DOI":"10.1016\/j.apenergy.2018.07.101","article-title":"Data-driven multi-objective optimisation of coal-fired boiler combustion systems","volume":"229","author":"Rahat","year":"2018","journal-title":"Applied Energy"},{"key":"2023120113073297200_B27","volume-title":"Gaussian processes for machine learning","author":"Rasmussen","year":"2006"},{"key":"2023120113073297200_B28","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1109\/JPROC.2015.2494218","article-title":"Taking the human out of the loop: A review of Bayesian optimization","volume":"104","author":"Shahriari","year":"2016","journal-title":"Proceedings of the IEEE"},{"key":"2023120113073297200_B29","first-page":"1257","article-title":"Sparse Gaussian processes using pseudo-inputs","author":"Snelson","year":"2005","journal-title":"Proceedings of the 18th International Conference on Neural Information Processing Systems"},{"key":"2023120113073297200_B30","first-page":"2951","article-title":"Practical Bayesian optimization of machine learning algorithms","volume-title":"Advances in neural information processing systems","author":"Snoek","year":"2012"},{"key":"2023120113073297200_B31","first-page":"567","article-title":"Variational learning of inducing variables in sparse Gaussian processes","author":"Titsias","year":"2009","journal-title":"Proceedings of the Twelth International Conference on Artificial Intelligence and Statistics"},{"key":"2023120113073297200_B32","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1007\/978-3-319-24465-5_27","article-title":"Optimally weighted cluster kriging for big data regression","volume-title":"Advances in intelligent data analysis XIV","author":"van Stein","year":"2015"},{"key":"2023120113073297200_B33","doi-asserted-by":"publisher","first-page":"536","DOI":"10.1109\/TCYB.2018.2869674","article-title":"A random forest-assisted evolutionary algorithm for data-driven constrained multiobjective combinatorial optimization of trauma systems","volume":"50","author":"Wang","year":"2020","journal-title":"IEEE Transactions on Cybernetics"},{"key":"2023120113073297200_B34","doi-asserted-by":"publisher","first-page":"939","DOI":"10.1109\/TEVC.2016.2555315","article-title":"Data-driven surrogate-assisted multiobjective evolutionary optimization of a trauma system","volume":"20","author":"Wang","year":"2016","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2023120113073297200_B35","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1109\/TEVC.2018.2834881","article-title":"Offline data-driven evolutionary optimization using selective surrogate ensembles","volume":"23","author":"Wang","year":"2019","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2023120113073297200_B36","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1145\/3071178.3071321","article-title":"Time complexity reduction in efficient global optimization using cluster kriging","author":"Wang","year":"2017","journal-title":"Proceedings of the Genetic and Evolutionary Computation Conference"},{"key":"2023120113073297200_B37","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1109\/TEVC.2019.2925959","article-title":"Offline data-driven multiobjective optimization: Knowledge transfer between surrogates and generation of final solutions","volume":"24","author":"Yang","year":"2020","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2023120113073297200_B38","doi-asserted-by":"publisher","first-page":"712","DOI":"10.1109\/TEVC.2007.892759","article-title":"MOEA\/D: A multiobjective evolutionary algorithm based on decomposition","volume":"11","author":"Zhang","year":"2007","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2023120113073297200_B39","first-page":"292","article-title":"Multiobjective optimization using evolutionary algorithms\u2014A comparative case study","author":"Zitzler","year":"1998","journal-title":"Parallel Problem Solving from Nature"}],"container-title":["Evolutionary Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/evco\/article-pdf\/31\/4\/375\/2162637\/evco_a_00329.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/evco\/article-pdf\/31\/4\/375\/2162637\/evco_a_00329.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,1]],"date-time":"2023-12-01T13:08:08Z","timestamp":1701436088000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/evco\/article\/31\/4\/375\/115843\/Treed-Gaussian-Process-Regression-for-Solving"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"references-count":39,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,12,1]]},"published-print":{"date-parts":[[2023,12,1]]}},"URL":"https:\/\/doi.org\/10.1162\/evco_a_00329","relation":{},"ISSN":["1530-9304"],"issn-type":[{"value":"1530-9304","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023]]},"published":{"date-parts":[[2023]]}}}