{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T00:07:27Z","timestamp":1773965247247,"version":"3.50.1"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,3,8]],"date-time":"2022-03-08T00:00:00Z","timestamp":1646697600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Research Grants Council of Hong Kong SAR","award":["CUHK14209420"],"award-info":[{"award-number":["CUHK14209420"]}]},{"DOI":"10.13039\/501100010428","name":"Innovation and Technology Fund","doi-asserted-by":"crossref","award":["PRP\/065\/20FX"],"award-info":[{"award-number":["PRP\/065\/20FX"]}],"id":[{"id":"10.13039\/501100010428","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Des. Autom. Electron. Syst."],"published-print":{"date-parts":[[2022,7,31]]},"abstract":"<jats:p>\n            High-level synthesis (HLS) tools have gained great attention in recent years because it emancipates engineers from the complicated and heavy hardware description language writing and facilitates the implementations of modern applications (e.g., deep learning models) on\n            <jats:bold>Field-programmable Gate Array (FPGA)<\/jats:bold>\n            , by using high-level languages and HLS directives. However, finding good HLS directives is challenging, due to the time-consuming design processes, the balances among different design objectives, and the diverse fidelities (accuracies of data) of the performance values between the consecutive FPGA design stages.\n          <\/jats:p>\n          <jats:p>To find good HLS directives, a novel automatic optimization algorithm is proposed to explore the Pareto designs of the multiple objectives while making full use of the data with different fidelities from different FPGA design stages. Firstly, a non-linear Gaussian process (GP) is proposed to model the relationships among the different FPGA design stages. Secondly, for the first time, the GP model is enhanced as correlated GP (CGP) by considering the correlations between the multiple design objectives, to find better Pareto designs. Furthermore, we extend our model to be a deep version deep CGP (DCGP) by using the deep neural network to improve the kernel functions in Gaussian process models, to improve the characterization capability of the models, and learn better feature representations. We test our design method on some public benchmarks (including general matrix multiplication and sparse matrix-vector multiplication) and deep learning-based object detection model iSmart2 on FPGA. Experimental results show that our methods outperform the baselines significantly and facilitate the deep learning designs on FPGA.<\/jats:p>","DOI":"10.1145\/3503540","type":"journal-article","created":{"date-parts":[[2022,3,8]],"date-time":"2022-03-08T16:32:11Z","timestamp":1646757131000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":38,"title":["Correlated Multi-objective Multi-fidelity Optimization for HLS Directives Design"],"prefix":"10.1145","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5153-6698","authenticated-orcid":false,"given":"Qi","family":"Sun","sequence":"first","affiliation":[{"name":"The Chinese University of Hong Kong, Shanghai, China"}]},{"given":"Tinghuan","family":"Chen","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong, Shanghai, China"}]},{"given":"Siting","family":"Liu","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong, Shanghai, China"}]},{"given":"Jianli","family":"Chen","sequence":"additional","affiliation":[{"name":"Fudan University, Shenzhen, China"}]},{"given":"Hao","family":"Yu","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology, Shenzhen, China"}]},{"given":"Bei","family":"Yu","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong, Shanghai, China"}]}],"member":"320","published-online":{"date-parts":[[2022,3,8]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"21524","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Balandat Maximilian","year":"2020","unstructured":"Maximilian Balandat, Brian Karrer, Daniel Jiang, Samuel Daulton, Ben Letham, Andrew G. Wilson, and Eytan Bakshy. 2020. BoTorch: A framework for efficient Monte-Carlo Bayesian optimization. In Proceedings of the Advances in Neural Information Processing Systems. 21524\u201321538. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/f5b1b89d98b7286673128a5fb112cb9a-Abstract.html."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE.2018.8341976"},{"key":"e_1_3_2_4_2","first-page":"7825","article-title":"Max-value entropy search for multi-objective Bayesian optimization","volume":"32","author":"Belakaria Syrine","year":"2019","unstructured":"Syrine Belakaria, Aryan Deshwal, and Janardhan Rao Doppa. 2019. Max-value entropy search for multi-objective Bayesian optimization. Advances in Neural Information Processing Systems 32 (2019), 7825\u20137835. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/82edc5c9e21035674d481640448049f3-Abstract.html.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_5_2","first-page":"153","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Bonilla Edwin V.","year":"2008","unstructured":"Edwin V. Bonilla, Kian M. Chai, and Christopher Williams. 2008. Multi-task Gaussian process prediction. In Proceedings of the Advances in Neural Information Processing Systems. 153\u2013160. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2007\/hash\/66368270ffd51418ec58bd793f2d9b1b-Abstract.html."},{"key":"e_1_3_2_6_2","volume-title":"Data Preparation for Machine Learning: Data Cleaning, Feature Selection, and Data Transforms in Python","author":"Brownlee Jason","year":"2020","unstructured":"Jason Brownlee. 2020. Data Preparation for Machine Learning: Data Cleaning, Feature Selection, and Data Transforms in Python. Machine Learning Mastery."},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2020.3015438"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3316781.3317909"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASICON52560.2021.9620496"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/FCCM.2018.00029"},{"key":"e_1_3_2_11_2","volume-title":"International Conference on Learning Representations (ICLR)","author":"Matthews Alexander G. de G.","year":"2018","unstructured":"Alexander G. de G. Matthews, Jiri Hron, Mark Rowland, Richard E. Turner, and Zoubin Ghahramani. 2018. Gaussian Process Behaviour in Wide Deep Neural Networks. In International Conference on Learning Representations (ICLR). https:\/\/arxiv.org\/abs\/1804.11271."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCD.2018.00040"},{"key":"e_1_3_2_13_2","first-page":"7587","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Gardner Jacob","year":"2018","unstructured":"Jacob Gardner, Geoff Pleiss, Kilian Q. Weinberger, David Bindel, and Andrew G. Wilson. 2018. GPyTorch: Blackbox matrix-matrix Gaussian process inference with GPU acceleration. In Proceedings of the Advances in Neural Information Processing Systems. 7587\u20137597. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/27e8e17134dd7083b050476733207ea1-Abstract.html."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2021.3114262"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3316781.3317829"},{"key":"e_1_3_2_16_2","first-page":"1492","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Hern\u00e1ndez-Lobato Daniel","year":"2016","unstructured":"Daniel Hern\u00e1ndez-Lobato, Jose Hernandez-Lobato, Amar Shah, and Ryan Adams. 2016. Predictive entropy search for multi-objective Bayesian optimization. In Proceedings of the International Conference on Machine Learning. PMLR, 1492\u20131501. Retrieved from http:\/\/proceedings.mlr.press\/v48\/hernandez-lobatoa16.html."},{"key":"e_1_3_2_17_2","first-page":"918","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Hern\u00e1ndez-Lobato Jos\u00e9 Miguel","year":"2014","unstructured":"Jos\u00e9 Miguel Hern\u00e1ndez-Lobato, Matthew W. Hoffman, and Zoubin Ghahramani. 2014. Predictive entropy search for efficient global optimization of black-box functions. In Proceedings of the Advances in Neural Information Processing Systems. 918\u2013926. Retrieved from https:\/\/papers.nips.cc\/paper\/2014\/hash\/069d3bb002acd8d7dd095917f9efe4cb-Abstract.html."},{"key":"e_1_3_2_18_2","unstructured":"iSmartDNN. Retrieved from https:\/\/github.com\/onioncc\/iSmartDNN. (????)."},{"key":"e_1_3_2_19_2","first-page":"3094","volume-title":"Proceedings of the Advances in Neural Information Processing Systems.","author":"Khan Mohammad Emtiyaz E.","year":"2019","unstructured":"Mohammad Emtiyaz E. Khan, Alexander Immer, Ehsan Abedi, and Maciej Korzepa. 2019. Approximate inference turns deep networks into Gaussian processes. In Proceedings of the Advances in Neural Information Processing Systems.3094\u20133104. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/b3bbccd6c008e727785cb81b1aa08ac5-Abstract.html."},{"key":"e_1_3_2_20_2","first-page":"1","volume-title":"MBMV 2021; 24th Workshop","author":"Letras Martin","year":"2021","unstructured":"Martin Letras, Joachim Falk, and Juergen Teich. 2021. Decision tree-based throughput estimation to accelerate design space exploration for multi-core applications. In MBMV 2021; 24th Workshop. 1\u201311. Retrieved from https:\/\/ieeexplore.ieee.org\/abstract\/document\/9399720."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2897937.2898028"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/2463209.2488795"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3316781.3317754"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE51398.2021.9473959"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/FPL.2016.7577358"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/FPL.2018.00054"},{"key":"e_1_3_2_27_2","first-page":"3312","volume-title":"Proceedings of the International Conference on Machine Learning.","author":"Lyu Wenlong","year":"2018","unstructured":"Wenlong Lyu, Fan Yang, Changhao Yan, Dian Zhou, and Xuan Zeng. 2018. Batch Bayesian optimization via multi-objective acquisition ensemble for automated analog circuit design. In Proceedings of the International Conference on Machine Learning.3312\u20133320. Retrieved from http:\/\/proceedings.mlr.press\/v80\/lyu18a.html."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/ESLsyn.2014.6850383"},{"key":"e_1_3_2_29_2","volume-title":"Proceedings of the Thirty-Seventh Conference on Uncertainty in Artificial Intelligence (UAI)","author":"Ober Sebastian W.","year":"2021","unstructured":"Sebastian W. Ober, Carl E. Rasmussen, and Mark van der Wilk. 2021. The promises and pitfalls of deep kernel learning. In Proceedings of the Thirty-Seventh Conference on Uncertainty in Artificial Intelligence (UAI), Vol. 161. PMLR, 1206\u20131216. https:\/\/proceedings.mlr.press\/v161\/ober21a.html."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240765.3240816"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSD.2013.30"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.5555\/1046920.1194909"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-28650-9_4"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/IISWC.2014.6983050"},{"key":"e_1_3_2_35_2","first-page":"2188","volume-title":"Proceedings of the International Conference on Artificial Intelligence and Statistics.","author":"Sapkota Hitesh","year":"2021","unstructured":"Hitesh Sapkota, Yiming Ying, Feng Chen, and Qi Yu. 2021. Distributionally robust optimization for deep kernel multiple instance learning. In Proceedings of the International Conference on Artificial Intelligence and Statistics. PMLR, 2188\u20132196. Retrieved from http:\/\/proceedings.mlr.press\/v130\/sapkota21a.html."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2009.2035579"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/2209291.2209302"},{"key":"e_1_3_2_38_2","first-page":"1919","volume-title":"Proceedings of the International Conference on Machine Learning.","author":"Shah Amar","year":"2016","unstructured":"Amar Shah and Zoubin Ghahramani. 2016. Pareto frontier learning with expensive correlated objectives. In Proceedings of the International Conference on Machine Learning.1919\u20131927. Retrieved from http:\/\/proceedings.mlr.press\/v48\/shahc16.html."},{"key":"e_1_3_2_39_2","first-page":"2951","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Snoek Jasper","year":"2012","unstructured":"Jasper Snoek, Hugo Larochelle, and Ryan P. Adams. 2012. Practical Bayesian optimization of machine learning algorithms. In Proceedings of the Advances in Neural Information Processing Systems. 2951\u20132959. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2012\/hash\/05311655a15b75fab86956663e1819cd-Abstract.html."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAD45719.2019.8942085"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE51398.2021.9474241"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/FCCM.2019.00020"},{"key":"e_1_3_2_43_2","unstructured":"Vivado Design Suite User Guide: High-Level Synthesis. Retrieved from https:\/\/www.xilinx.com\/support\/documentation\/sw_manuals\/xilinx2018_3\/ug902-vivado-high-level-synthesis.pdf. (????)."},{"key":"e_1_3_2_44_2","article-title":"Meta-learning acquisition functions for transfer learning in Bayesian optimization","author":"Volpp Michael","year":"2020","unstructured":"Michael Volpp, Lukas P. Fr\u00f6hlich, Kirsten Fischer, Andreas Doerr, Stefan Falkner, Frank Hutter, and Christian Daniel. 2020. Meta-learning acquisition functions for transfer learning in Bayesian optimization. In Proceedings of the International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=ryeYpJSKwr.","journal-title":"Proceedings of the International Conference on Learning Representations"},{"key":"e_1_3_2_45_2","first-page":"3627","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Wang Zi","year":"2017","unstructured":"Zi Wang and Stefanie Jegelka. 2017. Max-value entropy search for efficient Bayesian optimization. In Proceedings of the International Conference on Machine Learning. PMLR, 3627\u20133635. Retrieved from http:\/\/proceedings.mlr.press\/v70\/wang17e.html."},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3316781.3317875"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3061639.3062207"},{"key":"e_1_3_2_48_2","first-page":"1775","volume-title":"Proceedings of the International Conference on Machine Learning.","author":"Wilson Andrew","year":"2015","unstructured":"Andrew Wilson and Hannes Nickisch. 2015. Kernel interpolation for scalable structured Gaussian processes (KISS-GP). In Proceedings of the International Conference on Machine Learning. PMLR, 1775\u20131784. Retrieved from http:\/\/proceedings.mlr.press\/v37\/wilson15.html."},{"key":"e_1_3_2_49_2","first-page":"370","volume-title":"Proceedings of the International Conference on Artificial Intelligence and Statistics","author":"Wilson Andrew Gordon","year":"2016","unstructured":"Andrew Gordon Wilson, Zhiting Hu, Ruslan Salakhutdinov, and Eric P. Xing. 2016. Deep kernel learning. In Proceedings of the International Conference on Artificial Intelligence and Statistics. 370\u2013378. Retrieved from http:\/\/proceedings.mlr.press\/v51\/wilson16.html."},{"key":"e_1_3_2_50_2","first-page":"2586","volume-title":"Proceedings of the Advances in Neural Information Processing Systems.","author":"Wilson Andrew G.","year":"2016","unstructured":"Andrew G. Wilson, Zhiting Hu, Russ R. Salakhutdinov, and Eric P. Xing. 2016. Stochastic variational deep kernel learning. In Proceedings of the Advances in Neural Information Processing Systems.2586\u20132594. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2016\/hash\/bcc0d400288793e8bdcd7c19a8ac0c2b-Abstract.html."},{"key":"e_1_3_2_51_2","first-page":"9884","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","volume":"31","author":"Wilson James T.","year":"2018","unstructured":"James T. Wilson, Frank Hutter, and Marc Peter Deisenroth. 2018. Maximizing acquisition functions for Bayesian optimization. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 31. 9884\u20139895. Retrieved from https:\/\/papers.nips.cc\/paper\/2018\/hash\/498f2c21688f6451d9f5fd09d53edda7-Abstract.html."},{"key":"e_1_3_2_52_2","volume-title":"Workshop on Bayesian Optimization of Conference on Neural Information Processing Systems (NeurIPS)","author":"Wilson James T.","year":"2017","unstructured":"James T. Wilson, Riccardo Moriconi, Frank Hutter, and Marc Peter Deisenroth. 2017. The reparameterization trick for acquisition functions. In Workshop on Bayesian Optimization of Conference on Neural Information Processing Systems (NeurIPS). https:\/\/arxiv.org\/abs\/1712.00424"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/DAC18072.2020.9218684"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE48585.2020.9116535"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAD.2017.8203809"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2019.2912916"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE.2019.8714724"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/2897937.2898040"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAD.2015.7372592"}],"container-title":["ACM Transactions on Design Automation of Electronic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503540","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3503540","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:19Z","timestamp":1750186939000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503540"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,8]]},"references-count":58,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,7,31]]}},"alternative-id":["10.1145\/3503540"],"URL":"https:\/\/doi.org\/10.1145\/3503540","relation":{},"ISSN":["1084-4309","1557-7309"],"issn-type":[{"value":"1084-4309","type":"print"},{"value":"1557-7309","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,8]]},"assertion":[{"value":"2021-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}