{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T13:51:38Z","timestamp":1767966698538,"version":"3.49.0"},"reference-count":52,"publisher":"SAGE Publications","issue":"3-4","license":[{"start":{"date-parts":[[2024,3,30]],"date-time":"2024-03-30T00:00:00Z","timestamp":1711756800000},"content-version":"vor","delay-in-days":366,"URL":"http:\/\/www.sagepub.com\/licence-information-for-chorus"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2004541"],"award-info":[{"award-number":["2004541"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006132","name":"Office of Science","doi-asserted-by":"publisher","award":["17-SC-20-SC"],"award-info":[{"award-number":["17-SC-20-SC"]}],"id":[{"id":"10.13039\/100006132","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006132","name":"Office of Science","doi-asserted-by":"publisher","award":["DE-SC0021419"],"award-info":[{"award-number":["DE-SC0021419"]}],"id":[{"id":"10.13039\/100006132","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006132","name":"Office of Science","doi-asserted-by":"publisher","award":["DE-AC05-00OR22725"],"award-info":[{"award-number":["DE-AC05-00OR22725"]}],"id":[{"id":"10.13039\/100006132","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006132","name":"Office of Science","doi-asserted-by":"publisher","award":["DE-AC52-07NA27344"],"award-info":[{"award-number":["DE-AC52-07NA27344"]}],"id":[{"id":"10.13039\/100006132","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:p> We combine deep Gaussian processes (DGPs) with multitask and transfer learning for the performance modeling and optimization of HPC applications. Deep Gaussian processes merge the uncertainty quantification advantage of Gaussian processes (GPs) with the predictive power of deep learning. Multitask and transfer learning allow for improved learning efficiency when several similar tasks are to be learned simultaneously and when previous learned models are sought to help in the learning of new tasks, respectively. A comparison with state-of-the-art autotuners shows the advantage of our approach on two application problems. In this article, we combine DGPs with multitask and transfer learning to allow for both an improved tuning of an application parameters on problems of interest but also the prediction of parameters on any potential problem the application might encounter. <\/jats:p>","DOI":"10.1177\/10943420231166365","type":"journal-article","created":{"date-parts":[[2023,3,30]],"date-time":"2023-03-30T09:07:17Z","timestamp":1680167237000},"page":"229-244","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":4,"title":["Combining multitask and transfer learning with deep Gaussian processes for autotuning-based performance engineering"],"prefix":"10.1177","volume":"37","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0089-6965","authenticated-orcid":false,"given":"Piotr","family":"Luszczek","sequence":"first","affiliation":[{"name":"The University of Tennessee, Knoxville, TN, USA"}]},{"given":"Wissam M","family":"Sid-Lakhdar","sequence":"additional","affiliation":[{"name":"The University of Tennessee, Knoxville, TN, USA"}]},{"given":"Jack","family":"Dongarra","sequence":"additional","affiliation":[{"name":"The University of Tennessee, Knoxville, TN, USA"},{"name":"Oak Ridge National Laboratory, Oak Ridge, TN, USA"},{"name":"University of Manchester, Manchester, UK"}]}],"member":"179","published-online":{"date-parts":[[2023,3,30]]},"reference":[{"key":"bibr1-10943420231166365","first-page":"1459","volume":"12","author":"Alvarez MA","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"bibr2-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1023\/A:1020281327116"},{"key":"bibr3-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1145\/2628071.2628092"},{"key":"bibr4-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.3516"},{"key":"bibr5-10943420231166365","volume-title":"SuRF: Search Using Random Forest","author":"Balaprakash P","year":"2015"},{"key":"bibr6-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2018.2841200"},{"key":"bibr7-10943420231166365","volume-title":"Dynamic Programming","author":"Bellman R","year":"1957"},{"key":"bibr8-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1088\/1749-4699\/8\/1\/014008"},{"key":"bibr9-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2017.1285773"},{"key":"bibr10-10943420231166365","volume-title":"Multi-task Gaussian Process Prediction","author":"Bonilla EV","year":"2008"},{"key":"bibr11-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1145\/1998196.1998198"},{"key":"bibr12-10943420231166365","first-page":"1683","volume-title":"International Conference on Machine Learning","author":"Chen T","year":"2014"},{"key":"bibr13-10943420231166365","first-page":"207","volume":"16","author":"Damianou A","year":"2013","journal-title":"Artificial Intelligence and Statistics"},{"issue":"1","key":"bibr14-10943420231166365","first-page":"104","volume":"35","author":"Eglajs V","year":"1977","journal-title":"Problems of Dynamics and Strengths"},{"key":"bibr15-10943420231166365","first-page":"1437","volume-title":"Proceedings of the 35th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 80)","author":"Falkner S","year":"2018"},{"key":"bibr16-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780195115383.001.0001"},{"key":"bibr17-10943420231166365","first-page":"7517","volume-title":"Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS\u201918","author":"Havasi M","year":"2018"},{"key":"bibr18-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2018.8477946"},{"key":"bibr19-10943420231166365","doi-asserted-by":"publisher","DOI":"10.2514\/6.2019-1973"},{"key":"bibr20-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1007\/s11081-020-09517-8"},{"key":"bibr21-10943420231166365","first-page":"1809","volume":"13","author":"Hennig P","year":"2012","journal-title":"Journal of Machine Learning Research"},{"key":"bibr22-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1080\/00224065.1981.11978748"},{"key":"bibr23-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008306431147"},{"key":"bibr24-10943420231166365","volume-title":"Mining Geostatistics","author":"Journel AG","year":"1978"},{"key":"bibr25-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1287\/moor.12.2.262"},{"key":"bibr26-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1109\/ICNN.1995.488968"},{"key":"bibr27-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1126\/science.220.4598.671"},{"issue":"1","key":"bibr28-10943420231166365","first-page":"6765","volume":"18","author":"Li L","year":"2017","journal-title":"Journal of Machine Learning Research"},{"key":"bibr29-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1145\/3437801.3441621"},{"key":"bibr31-10943420231166365","first-page":"231","volume-title":"Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, Proceedings of Machine Learning Research, Volume 51","author":"Matthews AGG","year":"2016"},{"key":"bibr32-10943420231166365","doi-asserted-by":"publisher","DOI":"10.2307\/1268522"},{"key":"bibr33-10943420231166365","volume-title":"Proceedings of the 2009 International Meeting on High Performance Computing for Computational Science, VECPAR\u201910","author":"Nath R","year":"2010"},{"key":"bibr34-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1177\/1094342010385729"},{"key":"bibr35-10943420231166365","first-page":"113","volume":"54","author":"Neal RM","year":"2010","journal-title":"Handbook of Markov Chain Monte Carlo"},{"key":"bibr36-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/7.4.308"},{"key":"bibr37-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"bibr38-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2018.03.017"},{"key":"bibr39-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1098\/rspa.2015.0018"},{"key":"bibr40-10943420231166365","volume-title":"Advances in Neural Information Processing Systems, Volume 30","author":"Qin C","year":"2017"},{"key":"bibr41-10943420231166365","doi-asserted-by":"publisher","DOI":"10.2514\/1.C036026"},{"key":"bibr42-10943420231166365","volume-title":"Gaussian Processes for Machine Learning","author":"Rasmussen CE","year":"2006"},{"key":"bibr43-10943420231166365","volume-title":"Advances in Neural Information Processing Systems, Volume 30","author":"Salimbeni H","year":"2017"},{"key":"bibr44-10943420231166365","volume-title":"Semiparametric Latent Factor Models","author":"Seeger M","year":"2005"},{"key":"bibr45-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2015.2494218"},{"key":"bibr46-10943420231166365","volume-title":"Gptune Users Guide","author":"Sid-Lakhdar WM","year":"2020"},{"key":"bibr47-10943420231166365","volume-title":"Proceedings of NIPS","author":"Snoek J","year":"2012"},{"key":"bibr48-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1109\/2.294849"},{"key":"bibr49-10943420231166365","volume-title":"Advances in Neural Information Processing Systems, Volume 26","author":"Swersky K","year":"2013"},{"key":"bibr53-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511984679.006"},{"key":"bibr50-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1115\/1.2429697"},{"key":"bibr51-10943420231166365","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1990.10474930"},{"key":"bibr52-10943420231166365","unstructured":"Zhang Y, Yang Q (2017) A survey on multi-task learning. In: CoRR abs\/1707.08114, 1. arXiv:1707.08114."}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420231166365","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10943420231166365","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420231166365","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420231166365","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,28]],"date-time":"2025-02-28T22:03:35Z","timestamp":1740780215000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10943420231166365"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,30]]},"references-count":52,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["10.1177\/10943420231166365"],"URL":"https:\/\/doi.org\/10.1177\/10943420231166365","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,30]]}}}