{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T23:10:07Z","timestamp":1750893007678,"version":"3.41.0"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"5s","license":[{"start":{"date-parts":[[2017,9,27]],"date-time":"2017-09-27T00:00:00Z","timestamp":1506470400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"H2020 project HERCULES","award":["688860"],"award-info":[{"award-number":["688860"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Embed. Comput. Syst."],"published-print":{"date-parts":[[2017,10,31]]},"abstract":"<jats:p>Shared virtual memory is key in heterogeneous systems on chip (SoCs) that combine a general-purpose host processor with a many-core accelerator, both for programmability and performance. In contrast to the full-blown, hardware-only solutions predominant in modern high-end systems, lightweight hardware-software co-designs are better suited in the context of more power- and area-constrained embedded systems and provide additional benefits in terms of flexibility and predictability. As a downside, the latter solutions require the host to handle in software synchronization in case of page misses as well as miss handling. This may incur considerable run-time overheads.<\/jats:p><jats:p>In this work, we present a novel hardware-software virtual memory management approach for many-core accelerators in heterogeneous embedded SoCs. It exploits an<jats:italic>accelerator-side<\/jats:italic>helper thread concept that enables the accelerator to manage its virtual memory hardware autonomously while operating cache-coherently on the page tables of the user-space processes of the host. This greatly reduces overhead with respect to host-side solutions while retaining flexibility. We have validated the design with a set of parameterizable benchmarks and real-world applications covering various application domains. For purely memory-bound kernels, the accelerator performance improves by a factor of 3.8 compared with host-based management and lies within 50% of a lower-bound ideal memory management unit.<\/jats:p>","DOI":"10.1145\/3126560","type":"journal-article","created":{"date-parts":[[2017,9,27]],"date-time":"2017-09-27T12:33:53Z","timestamp":1506515633000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Efficient Virtual Memory Sharing via On-Accelerator Page Table Walking in Heterogeneous Embedded SoCs"],"prefix":"10.1145","volume":"16","author":[{"given":"Pirmin","family":"Vogel","sequence":"first","affiliation":[{"name":"Integrated Systems Laboratory, ETH Zurich, Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andreas","family":"Kurth","sequence":"additional","affiliation":[{"name":"Integrated Systems Laboratory, ETH Zurich, Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johannes","family":"Weinbuch","sequence":"additional","affiliation":[{"name":"Integrated Systems Laboratory, ETH Zurich, Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Marongiu","sequence":"additional","affiliation":[{"name":"Integrated Systems Laboratory, ETH Zurich and Electrical, Electronic, and Information Engineering Department, University of Bologna, Bologna, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luca","family":"Benini","sequence":"additional","affiliation":[{"name":"Integrated Systems Laboratory, ETH Zurich and Electrical, Electronic, and Information Engineering Department, University of Bologna, Bologna, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,9,27]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Adapteva Inc. Parallela Reference Manual. Technical reference manual. (2014). Adapteva Inc. Parallela Reference Manual. Technical reference manual. (2014)."},{"key":"e_1_2_1_2_1","unstructured":"AMD Inc. AMD Compute Cores. White Paper. (2014). www.amd.com\/documents\/compute_cores_whitepaper.pdf. AMD Inc. AMD Compute Cores. White Paper. (2014). www.amd.com\/documents\/compute_cores_whitepaper.pdf."},{"key":"e_1_2_1_3_1","unstructured":"ARM Ltd. Cortex-A9 Floating-Point Unit. Technical reference manual. (2012). ARM Ltd. Cortex-A9 Floating-Point Unit. Technical reference manual. (2012)."},{"key":"e_1_2_1_4_1","unstructured":"ARM Ltd. AMBA AXI and ACE Protocol Specification. Protocol specification. (2013). ARM Ltd. AMBA AXI and ACE Protocol Specification. Protocol specification. (2013)."},{"key":"e_1_2_1_5_1","unstructured":"ARM Ltd. ARM CoreLink MMU-500 System Memory Management Unit. Technical reference manual. (2016). ARM Ltd. ARM CoreLink MMU-500 System Memory Management Unit. Technical reference manual. (2016)."},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"S. Brin and L. Page. 1998. The anatomy of a large-scale hypertextual web search engine. In IW3C-7. 107--117. S. Brin and L. Page. 1998. The anatomy of a large-scale hypertextual web search engine. In IW3C-7. 107--117.","DOI":"10.1016\/S0169-7552(98)00110-X"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897937.2897972"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"J. Cong Z. Fang Y. Hao and G. Reinman. 2017. Supporting address translation for accelerator-centric architectures. In HPCA-23. 37--48. J. Cong Z. Fang Y. Hao and G. Reinman. 2017. Supporting address translation for accelerator-centric architectures. In HPCA-23. 37--48.","DOI":"10.1109\/HPCA.2017.19"},{"key":"e_1_2_1_9_1","unstructured":"J. Corbet. Fixing the contiguous memory allocator. LWN article. (2015). http:\/\/lwn.net\/Articles\/636234\/. J. Corbet. Fixing the contiguous memory allocator. LWN article. (2015). http:\/\/lwn.net\/Articles\/636234\/."},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"J. Gall and V. Lempitsky. 2009. Class-specific hough forests for object detection. In CVPR-27. 1022--1029. J. Gall and V. Lempitsky. 2009. Class-specific hough forests for object detection. In CVPR-27. 1022--1029.","DOI":"10.1109\/CVPR.2009.5206740"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2014.49"},{"key":"e_1_2_1_12_1","volume-title":"www.hsafoundation.com","author":"Foundation HSA","year":"2012","unstructured":"HSA Foundation . HSA Foundation . ( 2012 ). www.hsafoundation.com . HSA Foundation. HSA Foundation. (2012). www.hsafoundation.com."},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"K. Hsieh S. Khan N. Vijaykumar K. K. Chang A. Boroumand S. Ghose and O. Mutlu. 2016. Accelerating pointer chasing in 3D-stacked memory: Challenges mechanisms evaluation. In ICCD-34. 25--32. K. Hsieh S. Khan N. Vijaykumar K. K. Chang A. Boroumand S. Ghose and O. Mutlu. 2016. Accelerating pointer chasing in 3D-stacked memory: Challenges mechanisms evaluation. In ICCD-34. 25--32.","DOI":"10.1109\/ICCD.2016.7753257"},{"key":"e_1_2_1_14_1","unstructured":"Intel Corp. The compute architecture of Intel Processor Graphics Gen9. White Paper. (2015). https:\/\/software.intel.com\/sites\/default\/files\/managed\/c5\/9a\/The-Compute-Architecture-of-Intel-Processor-Graphics-Gen9-v1d0.pdf. Intel Corp. The compute architecture of Intel Processor Graphics Gen9. White Paper. (2015). https:\/\/software.intel.com\/sites\/default\/files\/managed\/c5\/9a\/The-Compute-Architecture-of-Intel-Processor-Graphics-Gen9-v1d0.pdf."},{"key":"e_1_2_1_15_1","unstructured":"Intel Corp. Arria 10 Device Overview. Product Specification. (2016). Intel Corp. Arria 10 Device Overview. Product Specification. (2016)."},{"key":"e_1_2_1_16_1","unstructured":"Kalray S. A. MPPA MANYCORE. (2014). Kalray S. A. MPPA MANYCORE. (2014)."},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"G. Kornaros K. Harteros I. Christoforakis and M. Astrinaki. 2014. I\/O virtualization utilizing an efficient hardware system-level memory management unit. In ISSoC\u201914. 1--4. G. Kornaros K. Harteros I. Christoforakis and M. Astrinaki. 2014. I\/O virtualization utilizing an efficient hardware system-level memory management unit. In ISSoC\u201914. 1--4.","DOI":"10.1109\/ISSOC.2014.6972448"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993452.2993565"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/L-CA.2013.17"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2400682.2400687"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968455.2968509"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2228360.2228568"},{"key":"e_1_2_1_23_1","unstructured":"M. Nazarewicz. A deep dive into CMA. LWN article. (2012). http:\/\/lwn.net\/Articles\/486301\/. M. Nazarewicz. A deep dive into CMA. LWN article. (2012). http:\/\/lwn.net\/Articles\/486301\/."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2907972.2907976"},{"key":"e_1_2_1_25_1","unstructured":"O. Peleg A. Morrison B. Serebrin and D. Tsafrir. 2015. Utilizing the IOMMU scalably. In USENIX ATC\u201915. 549--562. O. Peleg A. Morrison B. Serebrin and D. Tsafrir. 2015. Utilizing the IOMMU scalably. In USENIX ATC\u201915. 549--562."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2541940.2541942"},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","unstructured":"J. Power M. D. Hill and D. A. Wood. 2014. Supporting x86-64 address translation for 100s of GPU lanes. In HPCA-20. 568--578. J. Power M. D. Hill and D. A. Wood. 2014. Supporting x86-64 address translation for 100s of GPU lanes. In HPCA-20. 568--578.","DOI":"10.1109\/HPCA.2014.6835965"},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","unstructured":"D. Rossi I. Loi F. Conti G. Tagliavini A. Pullini and A. Marongiu. 2014. Energy efficient parallel computing on the PULP platform with support for OpenMP. In ICEEEI-28. 1--5. D. Rossi I. Loi F. Conti G. Tagliavini A. Pullini and A. Marongiu. 2014. Energy efficient parallel computing on the PULP platform with support for OpenMP. In ICEEEI-28. 1--5.","DOI":"10.1109\/EEEI.2014.7005803"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2014.2380198"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000013087.49260.fb"},{"key":"e_1_2_1_31_1","first-page":"1947","article-title":"Lightweight virtual memory support for zero-copy sharing of pointer-rich data structures in heterogeneous embedded SoCs","volume":"28","author":"Vogel P.","year":"2017","unstructured":"P. Vogel , A. Marongiu , and L. Benini . 2017 . Lightweight virtual memory support for zero-copy sharing of pointer-rich data structures in heterogeneous embedded SoCs . IEEE TPDS 28 , 7 (2017), 1947 -- 1959 . P. Vogel, A. Marongiu, and L. Benini. 2017. Lightweight virtual memory support for zero-copy sharing of pointer-rich data structures in heterogeneous embedded SoCs. IEEE TPDS 28, 7 (2017), 1947--1959.","journal-title":"IEEE TPDS"},{"key":"e_1_2_1_32_1","unstructured":"Xilinx Inc. Zynq-7000 All Programmable SoC Overview. Product Specification. (2016). Xilinx Inc. Zynq-7000 All Programmable SoC Overview. Product Specification. (2016)."},{"key":"e_1_2_1_33_1","unstructured":"Xilinx Inc. SDSoC Environment User Guide. User Guide. (2017). https:\/\/www.xilinx.com\/support\/documentation\/sw_manuals\/xilinx2017_1\/ug1027-sdsoc-user-guide.pdf. Xilinx Inc. SDSoC Environment User Guide. User Guide. (2017). https:\/\/www.xilinx.com\/support\/documentation\/sw_manuals\/xilinx2017_1\/ug1027-sdsoc-user-guide.pdf."},{"key":"e_1_2_1_34_1","unstructured":"Xilinx Inc. Zynq UltraScale+ MPSoC Data Sheet: Overview. Advance Product Specification. (2017). Xilinx Inc. Zynq UltraScale+ MPSoC Data Sheet: Overview. Advance Product Specification. (2017)."}],"container-title":["ACM Transactions on Embedded Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3126560","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3126560","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T22:34:00Z","timestamp":1750890840000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3126560"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,27]]},"references-count":34,"journal-issue":{"issue":"5s","published-print":{"date-parts":[[2017,10,31]]}},"alternative-id":["10.1145\/3126560"],"URL":"https:\/\/doi.org\/10.1145\/3126560","relation":{},"ISSN":["1539-9087","1558-3465"],"issn-type":[{"type":"print","value":"1539-9087"},{"type":"electronic","value":"1558-3465"}],"subject":[],"published":{"date-parts":[[2017,9,27]]},"assertion":[{"value":"2017-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-09-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}