{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T15:01:24Z","timestamp":1761490884499,"version":"3.40.5"},"reference-count":62,"publisher":"Cambridge University Press (CUP)","issue":"4","license":[{"start":{"date-parts":[[2019,10,18]],"date-time":"2019-10-18T00:00:00Z","timestamp":1571356800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["AIEDAM"],"published-print":{"date-parts":[[2019,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In engineering design, surrogate models are often used instead of costly computer simulations. Typically, a single surrogate model is selected based on the previous experience. We observe, based on an analysis of the published literature, that fitting an ensemble of surrogates (EoS) based on cross-validation errors is more accurate but requires more computational time. In this paper, we propose a method to build an EoS that is both accurate and less computationally expensive. In the proposed method, the EoS is a weighted average surrogate of response surface models, kriging, and radial basis functions based on overall cross-validation error. We demonstrate that created EoS is accurate than individual surrogates even when fewer data points are used, so computationally efficient with relatively insensitive predictions. We demonstrate the use of an EoS using hot rod rolling as an example. Finally, we include a rule-based template which can be used for other problems with similar requirements, for example, the computational time, required accuracy, and the size of the data.<\/jats:p>","DOI":"10.1017\/s089006041900026x","type":"journal-article","created":{"date-parts":[[2019,10,18]],"date-time":"2019-10-18T09:51:08Z","timestamp":1571392268000},"page":"484-501","source":"Crossref","is-referenced-by-count":35,"title":["Ensemble of surrogates and cross-validation for rapid and accurate predictions using small data sets"],"prefix":"10.1017","volume":"33","author":[{"given":"Reza","family":"Alizadeh","sequence":"first","affiliation":[]},{"given":"Liangyue","family":"Jia","sequence":"additional","affiliation":[]},{"given":"Anand Balu","family":"Nellippallil","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2363-8595","authenticated-orcid":false,"given":"Guoxin","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Jia","family":"Hao","sequence":"additional","affiliation":[]},{"given":"Janet K.","family":"Allen","sequence":"additional","affiliation":[]},{"given":"Farrokh","family":"Mistree","sequence":"additional","affiliation":[]}],"member":"56","published-online":{"date-parts":[[2019,10,18]]},"reference":[{"doi-asserted-by":"publisher","key":"S089006041900026X_ref32","DOI":"10.1007\/s11663-003-0084-z"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref18","DOI":"10.1007\/BF02665443"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref40","DOI":"10.1115\/1.4041050"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref62","DOI":"10.1007\/s00158-017-1783-4"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref57","DOI":"10.1080\/0305215X.2015.1115645"},{"doi-asserted-by":"crossref","unstructured":"Viana FA , Picheny V and Haftka RT (2009) Conservative prediction via safety margin: design through cross-validation and benefits of multiple surrogates. Paper Presented at the ASME 2009 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, San Diego, California, USA.","key":"S089006041900026X_ref53","DOI":"10.1115\/DETC2009-87053"},{"unstructured":"Viana F , Haftka R , Steffen JV , Butkewitsch S and Leal MF (2008) Optimal use of multiple surrogate for reduced RMS error in meta-model. Paper Presented at the NSF Engineering Research and Innovation Conference, Knoxville, Tennessee.","key":"S089006041900026X_ref52"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref12","DOI":"10.1504\/IJQET.2017.088860"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref45","DOI":"10.1115\/1.4034035"},{"unstructured":"Samad A , Lee K-D , Kim K-Y and Haftka R (2007) Application of multiple-surrogate model to optimization of a dimpled channel. Paper Presented at the 7th World Congresses of Structural and Multidisciplinary Optimization, Seoul, Korea.","key":"S089006041900026X_ref44"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref41","DOI":"10.1177\/1687814016647947"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref37","DOI":"10.1007\/978-3-319-93025-1_8"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref34","DOI":"10.4271\/2015-01-1369"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref33","DOI":"10.1145\/1276958.1277203"},{"unstructured":"Jones SJ and Bhadeshia HKDH (2017) Program STRUCTURE on the Materials Algorithm Project Web Site. Available at http:\/\/www.msm.cam.ac.uk\/map\/steel\/programs\/structure.html.","key":"S089006041900026X_ref27"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref26","DOI":"10.1016\/S1359-6454(96)00392-8"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref23","DOI":"10.1007\/s00158-006-0051-9"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref22","DOI":"10.1007\/s00158-006-0051-9"},{"key":"S089006041900026X_ref19","doi-asserted-by":"crossref","first-page":"1573","DOI":"10.2514\/1.J052930","article-title":"Efficient global optimization with adaptive target setting","volume":"52","author":"Chaudhuri","year":"2014","journal-title":"AIAA Journal"},{"key":"S089006041900026X_ref17","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198538493.001.0001","volume-title":"Neural Networks for Pattern Recognition","author":"Bishop","year":"1995"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref13","DOI":"10.1007\/s10845-016-1223-0"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref55","DOI":"10.1007\/s10898-012-9892-5"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref10","DOI":"10.1504\/IJCAET.2017.080769"},{"doi-asserted-by":"crossref","unstructured":"Basudhar A (2012) Selection of anisotropic kernel parameters using multiple surrogate information. Paper Presented at the 12th AIAA Aviation Technology, Integration, and Operations (ATIO) Conference and 14th AIAA\/ISSMO Multidisciplinary Analysis and Optimization Conference, Indianapolis, Indiana.","key":"S089006041900026X_ref9","DOI":"10.2514\/6.2012-5576"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref6","DOI":"10.1109\/CEC.2012.6256491"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref4","DOI":"10.1016\/j.techfore.2015.11.030"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref15","DOI":"10.1109\/CEC.2016.7744340"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref3","DOI":"10.2118\/172536-MS"},{"key":"S089006041900026X_ref24","first-page":"1","article-title":"A multiple surrogate assisted evolutionary algorithm for optimization involving iterative solvers","volume":"49","author":"Habib","year":"2017","journal-title":"Engineering Optimization"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref11","DOI":"10.1080\/19942060.2015.1128359"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref59","DOI":"10.1007\/s00158-017-1891-1"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref14","DOI":"10.2514\/6.2010-3089"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref47","DOI":"10.2514\/2.5755"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref1","DOI":"10.1016\/j.eswa.2014.11.020"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref30","DOI":"10.1016\/j.ejor.2016.06.041"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref20","DOI":"10.1007\/s00158-014-1184-x"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref36","DOI":"10.2514\/6.2005-333"},{"key":"S089006041900026X_ref5","article-title":"Managing computational complexity using surrogate models: a critical review","author":"Alizadeh","year":"2019","journal-title":"Research in Engineering Design"},{"volume-title":"Modelling of Microstructural Banding During Transformations in Steel","year":"2007","author":"J\u00e4gle","key":"S089006041900026X_ref25"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref61","DOI":"10.1016\/j.petrol.2005.03.002"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref2","DOI":"10.1007\/s00158-008-0230-y"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref58","DOI":"10.1111\/j.0006-341X.2001.00081.x"},{"volume-title":"Design and Analysis of Experiments","year":"2017","author":"Montgomery","key":"S089006041900026X_ref38"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref51","DOI":"10.1115\/DETC2008-49240"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref31","DOI":"10.1016\/j.scriptamat.2006.02.025"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref54","DOI":"10.2514\/6.2010-3090"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref16","DOI":"10.1115\/1.4039450"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref43","DOI":"10.1115\/FEDSM2006-98368"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref39","DOI":"10.1115\/DETC2017-67570"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref49","DOI":"10.1007\/BF02651624"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref21","DOI":"10.1080\/19942060.2017.1330709"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref8","DOI":"10.1016\/j.renene.2014.09.001"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref29","DOI":"10.7307\/ptt.v25i6.1188"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref42","DOI":"10.1029\/2011WR011527"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref50","DOI":"10.1179\/mst.1995.11.10.994"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref7","DOI":"10.1016\/j.cageo.2016.02.022"},{"key":"S089006041900026X_ref28","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.24200\/sci.2016.3936","article-title":"A framework for performance evaluation of energy supply chain by a compatible network data envelopment analysis model","volume":"23","author":"Kaleibari","year":"2016","journal-title":"Scientia Iranica. Transaction E, Industrial Engineering"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref60","DOI":"10.1080\/15567036.2018.1476934"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref46","DOI":"10.1080\/0305215X.2015.1100470"},{"key":"S089006041900026X_ref35","first-page":"1","article-title":"A multiple surrogates based PSO algorithm","author":"Lv","year":"2018","journal-title":"Artificial Intelligence Review"},{"unstructured":"Villanueva D , Haftka RT , Le Riche R and Picard G (2013) Locating multiple candidate designs with surrogate-based optimization. Paper Presented at the 10th World Congress on structural and multidisciplinary optimization, Orlando, Florida, USA.","key":"S089006041900026X_ref56"},{"doi-asserted-by":"publisher","key":"S089006041900026X_ref48","DOI":"10.1115\/1.4039128"}],"container-title":["Artificial Intelligence for Engineering Design, Analysis and Manufacturing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S089006041900026X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,25]],"date-time":"2024-07-25T05:50:50Z","timestamp":1721886650000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S089006041900026X\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,18]]},"references-count":62,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,11]]}},"alternative-id":["S089006041900026X"],"URL":"https:\/\/doi.org\/10.1017\/s089006041900026x","relation":{},"ISSN":["0890-0604","1469-1760"],"issn-type":[{"type":"print","value":"0890-0604"},{"type":"electronic","value":"1469-1760"}],"subject":[],"published":{"date-parts":[[2019,10,18]]}}}