{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,13]],"date-time":"2026-11-13T17:50:12Z","timestamp":1794592212700,"version":"4.9.1"},"reference-count":64,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,2,7]],"date-time":"2025-02-07T00:00:00Z","timestamp":1738886400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSF","award":["CCF-2211557"],"award-info":[{"award-number":["CCF-2211557"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Des. Autom. Electron. Syst."],"published-print":{"date-parts":[[2025,3,31]]},"abstract":"<jats:p>High-Level Synthesis enables the rapid prototyping of hardware accelerators, by combining a high-level description of the functional behavior of a kernel with a set of micro-architecture optimizations as inputs. Such optimizations can be described by inserting pragmas e.g., pipelining and replication of units, or even higher level transformations for HLS such as automatic data caching using the AMD\/Xilinx Merlin compiler. Selecting the best combination of pragmas, even within a restricted set, remains particularly challenging and the typical state-of-practice uses design-space exploration to navigate this space. But due to the highly irregular performance distribution of pragma configurations, typical DSE approaches are either extremely time consuming, or operating on a severely restricted search space.<\/jats:p>\n          <jats:p>This work proposes a framework to automatically insert HLS pragmas in regular loop-based programs, supporting pipelining, unit replication, and data caching. We develop an analytical performance and resource model as a function of the input program properties and pragmas inserted, using non-linear constraints and objectives. We prove this model provides a lower bound on the actual performance after HLS. We then encode this model as a Non-Linear Program, by making the pragma configuration unknowns of the system, which is computed optimally by solving this NLP. This approach can also be used during DSE, to quickly prune points with a (possibly partial) pragma configuration, driven by lower bounds on achievable latency. We extensively evaluate our end-to-end, fully implemented system, showing it can effectively manipulate spaces of billions of designs in seconds to minutes for the kernels evaluated.<\/jats:p>","DOI":"10.1145\/3711847","type":"journal-article","created":{"date-parts":[[2025,1,9]],"date-time":"2025-01-09T11:40:47Z","timestamp":1736422847000},"page":"1-44","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Automatic Hardware Pragma Insertion in High-Level Synthesis: A Non-Linear Programming Approach"],"prefix":"10.1145","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3950-5818","authenticated-orcid":false,"given":"St\u00e9phane","family":"Pouget","sequence":"first","affiliation":[{"name":"Computer Science, University of California Los Angeles, Los Angeles, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Louis-No\u00ebl","family":"Pouchet","sequence":"additional","affiliation":[{"name":"Computer Science, Colorado State University, Fort Collins, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason","family":"Cong","sequence":"additional","affiliation":[{"name":"Computer Science Department, University of California Los Angeles, Los Angeles, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,2,7]]},"reference":[{"key":"e_1_3_2_2_2","series-title":"NIPS\u201923","volume-title":"Proceedings of the 37th International Conference on Neural Information Processing Systems","author":"Bai Yunsheng","year":"2024","unstructured":"Yunsheng Bai, Atefeh Sohrabizadeh, Zongyue Qin, Ziniu Hu, Yizhou Sun, and Jason Cong. 2024. Towards a comprehensive benchmark for high-level synthesis targeted to FPGAs. In Proceedings of the 37th International Conference on Neural Information Processing Systems (New Orleans, LA) (NIPS\u201923). Curran Associates Inc., Red Hook, NY, Article 1962, 12 pages."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICFPT47387.2019.00063"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","unstructured":"Suhail Basalama Atefeh Sohrabizadeh Jie Wang Licheng Guo and Jason Cong. 2023. FlexCNN: An end-to-end framework for composing CNN accelerators on FPGA. ACM Trans. Reconfigurable Technol. Syst. 16 2 Article 23 (Mar2023) 32 pages. DOI:10.1145\/3570928","DOI":"10.1145\/3570928"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/DAC56929.2023.10248016"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/1375581.1375595"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240765.3240850"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-26408-0_8"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/2934583.2953984"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","unstructured":"Jason Cong Bin Liu Stephen Neuendorffer Juanjo Noguera Kees Vissers and Zhiru Zhang. 2011. High-level synthesis for FPGAs: From prototyping to deployment. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 30 4 (2011) 473\u2013491. DOI:10.1109\/TCAD.2011.2110592","DOI":"10.1109\/TCAD.2011.2110592"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","unstructured":"Jacob Devlin Ming-Wei Chang Kenton Lee and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies NAACL-HLT 2019 Minneapolis MN USA June 2-7 2019 Volume 1 (Long and Short Papers) Jill Burstein Christy Doran and Thamar Solorio (Eds.). Association for Computational Linguistics 4171\u20134186. 10.18653\/V1\/N19-1423","DOI":"10.18653\/V1\/N19-1423"},{"key":"e_1_3_2_12_2","unstructured":"Zijian Ding Atefeh Sohrabizadeh Weikai Li Zongyue Qin Yizhou Sun and Jason Cong. 2024. Efficient Task Transfer for HLS DSE. arXiv:2408.13270. Retrieved from https:\/\/arxiv.org\/abs\/2408.13270"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3490422.3502368"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2676726.2677010"},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","unstructured":"P. Feautrier. 1992. Some efficient solutions to the affine scheduling problem part II: Multidimensional time. International Journal of Parallel Programming 21 6 (1992) 389\u2013420.","DOI":"10.1007\/BF01379404"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCD.2018.00040"},{"key":"e_1_3_2_17_2","doi-asserted-by":"crossref","unstructured":"Sylvain Girbal Nicolas Vasilache C\u00e9dric Bastoul Albert Cohen David Parello Marc Sigler and Olivier Temam. 2006. Semi-automatic composition of loop transformations. International Journal of Parallel Programming 34 3 (June2006) 261\u2013317.","DOI":"10.1007\/s10766-006-0012-3"},{"key":"e_1_3_2_18_2","first-page":"326","volume-title":"Proceedings of the Thirteenth Annual ACM Symposium on Theory of Computing","author":"Hong Jia-Wei","year":"1981","unstructured":"Jia-Wei Hong and Hsiang-Tsung Kung. 1981. I\/O complexity: The red-blue pebble game. In Proceedings of the Thirteenth Annual ACM Symposium on Theory of Computing. 326\u2013333."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","unstructured":"Sitao Huang Kun Wu Hyunmin Jeong Chengyue Wang Deming Chen and Wen-Mei Hwu. 2021. PyLog: An algorithm-centric python-based FPGA programming and synthesis flow. IEEE Trans. Comput. 70 12 (2021) 2015\u20132028. DOI:10.1109\/TC.2021.3123465","DOI":"10.1109\/TC.2021.3123465"},{"key":"e_1_3_2_20_2","unstructured":"Intel. 2023. Intel. Retrieved from https:\/\/www.intel.com\/content\/www\/us\/en\/software\/programmable\/quartus-prime\/hls-compiler.html"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA.2016.20"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3289602.3293910"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/CGO51591.2021.9370308"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3373087.3375320"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/2463209.2488795"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.23919\/FPL.2017.8056810"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3316781.3317754"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/FPL.2019.00069"},{"key":"e_1_3_2_29_2","unstructured":"Microchip. 2023. SmartHLS Compiler Software. Retrieved from https:\/\/www.microchip.com\/en-us\/products\/fpgas-and-plds\/fpga-and-soc-design-tools\/smarthls-compiler"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICAT57854.2023.10171329"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240765.3240816"},{"key":"e_1_3_2_32_2","unstructured":"Louis-Noel Pouchet and Tomofumi Yuki. 2024. Polybench: The polyhedral benchmark suite. Retrieved from http:\/\/polybench.sourceforge.net"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/2435264.2435273"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3711847"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3670474.3685952"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPSW.2019.00028"},{"key":"e_1_3_2_37_2","volume-title":"BARON 21.1.13: Global Optimization of Mixed-Integer Nonlinear Programs, User\u2019s Manual","author":"Sahinidis N. V.","year":"2017","unstructured":"N. V. Sahinidis. 2017. BARON 21.1.13: Global Optimization of Mixed-Integer Nonlinear Programs, User\u2019s Manual."},{"key":"e_1_3_2_38_2","doi-asserted-by":"crossref","unstructured":"B. Carrion Schafer and Kazutoshi Wakabayashi. 2012. Machine learning predictive modelling high-level synthesis design space exploration. IET Computers & Digital Techniques 6 3 (2012) 153\u2013159.","DOI":"10.1049\/iet-cdt.2011.0115"},{"key":"e_1_3_2_39_2","unstructured":"Siemens. 2023. Catapult High-Level Synthesis. Retrieved from https:\/\/eda.sw.siemens.com\/en-US\/ic\/catapult-high-level-synthesis\/"},{"key":"e_1_3_2_40_2","volume-title":"2022 59th ACM\/IEEE Design Automation Conference (DAC\u201922)","author":"Sohrabizadeh Atefeh","year":"2022","unstructured":"Atefeh Sohrabizadeh, Yunsheng Bai, Yizhou Sun, and Jason Cong. 2022. Automated accelerator optimization aided by graph neural networks. In 2022 59th ACM\/IEEE Design Automation Conference (DAC\u201922)."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAD57390.2023.10323853"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAD57390.2023.10323853"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3373087.3375321"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","unstructured":"Atefeh Sohrabizadeh Cody Hao Yu Min Gao and Jason Cong. 2022. AutoDSE: Enabling software programmers to design efficient FPGA accelerators. ACM Trans. Des. Autom. Electron. Syst. 27 4 Article 32 (Feb2022) 27 pages. DOI:10.1145\/3494534","DOI":"10.1145\/3494534"},{"key":"e_1_3_2_45_2","doi-asserted-by":"crossref","unstructured":"M. Tawarmalani and N. V. Sahinidis. 2005. A polyhedral branch-and-cut approach to global optimization. Mathematical Programming 103 2 (2005) 225\u2013249.","DOI":"10.1007\/s10107-005-0581-8"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3431920.3439292"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3061639.3062251"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","unstructured":"Nan Wu Yuan Xie and Cong Hao. 2021. IRONMAN: GNN-assisted Design Space Explo<u>r<\/u>ati<u>o<\/u>n in High-Level Sy<u>n<\/u>thesis via Reinforce<u>m<\/u>ent Le<u>a<\/u>r<u>n<\/u>ing. In Proceedings of the 2021 Great Lakes Symposium on VLSI (GLSVLSI\u201921). Association for Computing Machinery Virtual Event USA 39\u201344. DOI:10.1145\/3453688.3461495","DOI":"10.1145\/3453688.3461495"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","unstructured":"Nan Wu Yuan Xie and Cong Hao. 2023. IronMan-Pro: Multiobjective design space exploration in HLS via reinforcement learning and graph neural network-based modeling. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 42 3 (2023) 900\u2013913. DOI:10.1109\/TCAD.2022.3185540","DOI":"10.1109\/TCAD.2022.3185540"},{"key":"e_1_3_2_50_2","unstructured":"AMD Xilinx. 2023. Merlin. Retrieved from https:\/\/github.com\/Xilinx\/merlin-compiler"},{"key":"e_1_3_2_51_2","unstructured":"AMD Xilinx. 2023. Vitis. Retrieved from https:\/\/www.xilinx.com\/products\/design-tools\/vitis\/vitis-platform.html"},{"key":"e_1_3_2_52_2","unstructured":"AMD Xilinx. 2024. AMD Xilinx Documentation: Target Flow. Retrieved from https:\/\/docs.amd.com\/r\/en-US\/ug1399-vitis-hls\/Target-Flow-Overview"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","unstructured":"Sotirios Xydis Gianluca Palermo Vittorio Zaccaria and Cristina Silvano. 2015. SPIRIT: Spectral-aware pareto iterative refinement optimization for supervised high-level synthesis. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 34 1 (2015) 155\u2013159. DOI:10.1109\/TCAD.2014.2363392","DOI":"10.1109\/TCAD.2014.2363392"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3489517.3530631"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/DAC.2018.8465827"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-91608-4_52"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240765.3240801"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3400302.3415609"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4020-8588-8_6"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAD.2017.8203809"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/2897937.2898040"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE.2017.7927161"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAD.2015.7372592"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAD.2015.7372592"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3061639.3062195"}],"container-title":["ACM Transactions on Design Automation of Electronic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3711847","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3711847","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:19:15Z","timestamp":1750295955000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3711847"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,7]]},"references-count":64,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,3,31]]}},"alternative-id":["10.1145\/3711847"],"URL":"https:\/\/doi.org\/10.1145\/3711847","relation":{},"ISSN":["1084-4309","1557-7309"],"issn-type":[{"value":"1084-4309","type":"print"},{"value":"1557-7309","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,7]]},"assertion":[{"value":"2024-06-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-13","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-02-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}