{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T22:14:58Z","timestamp":1767996898138,"version":"3.49.0"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"5s","license":[{"start":{"date-parts":[[2021,9,22]],"date-time":"2021-09-22T00:00:00Z","timestamp":1632268800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Embed. Comput. Syst."],"published-print":{"date-parts":[[2021,10,31]]},"abstract":"<jats:p>\n            Efficiently accessing remote file data remains a challenging problem for data processing systems. Development of technologies in non-volatile dual in-line memory modules (NVDIMMs), in-memory file systems, and RDMA networks provide new opportunities towards solving the problem of remote data access. A general understanding about NVDIMMs, such as Intel Optane DC Persistent Memory (DCPM), is that they expand main memory capacity with a cost of multiple times lower performance than DRAM. With an in-depth exploration presented in this paper, however, we show an interesting finding that the potential of NVDIMMs for high-performance, remote in-memory accesses can be revealed through careful design. We explore multiple architectural structures for accessing remote NVDIMMs in a real system using Optane DCPM, and compare the performance of various structures. Experiments are conducted to show significant performance gaps among different ways of using NVDIMMs as memory address space accessible through RDMA interface. Furthermore, we design and implement a prototype of user-level, in-memory file system, RIMFS, in the device DAX mode on Optane DCPM. By comparing against the DAX-supported Linux file system, Ext4-DAX, we show that the performance of remote reads on RIMFS over RDMA is 11.44\n            <jats:inline-formula>\n              <jats:alternatives>\n                <jats:tex-math>\n                  \n                <\/jats:tex-math>\n              <\/jats:alternatives>\n            <\/jats:inline-formula>\n            higher than that on a remote Ext4-DAX on average. The experimental results also show that the performance of remote accesses on RIMFS is maintained on a heavily loaded data server with CPU utilization as high as 90%, while the performance of remote reads on Ext4-DAX is significantly reduced by 49.3%, and the performance of local reads on Ext4-DAX is even more significantly reduced by 90.1%. The performance comparisons of writes exhibit the same trends.\n          <\/jats:p>","DOI":"10.1145\/3477004","type":"journal-article","created":{"date-parts":[[2021,9,22]],"date-time":"2021-09-22T20:48:40Z","timestamp":1632343720000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Exploring Efficient Architectures on Remote In-Memory NVM over RDMA"],"prefix":"10.1145","volume":"20","author":[{"given":"Qingfeng","family":"Zhuge","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, East China Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hao","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, East China Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5605-5631","authenticated-orcid":false,"given":"Edwin Hsing-Mean","family":"Sha","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, East China Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rui","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, East China Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Liu","sequence":"additional","affiliation":[{"name":"Levono Ltd., China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shengyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Levono Ltd., China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,9,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSST.2010.5496972"},{"key":"e_1_2_1_2_1","first-page":"21","article-title":"The hadoop distributed file system: Architecture and design","volume":"11","author":"Borthakur Dhruba","year":"2007","unstructured":"Dhruba Borthakur . 2007 . The hadoop distributed file system: Architecture and design . Hadoop Project Website 11 , 2007 (2007), 21 . Dhruba Borthakur. 2007. The hadoop distributed file system: Architecture and design. Hadoop Project Website 11, 2007 (2007), 21.","journal-title":"Hadoop Project Website"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/1298455.1298485"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/3408352.3408693"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCD50377.2020.00075"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1555815.1555760"},{"key":"e_1_2_1_7_1","volume-title":"The missing memristor found. nature 453, 7191","author":"Strukov Dmitri B.","year":"2008","unstructured":"Dmitri B. Strukov , Gregory S. Snider , Duncan R. Stewart , and R. Stanley Williams . 2008. The missing memristor found. nature 453, 7191 ( 2008 ), 80\u201383. Dmitri B. Strukov, Gregory S. Snider, Duncan R. Stewart, and R. Stanley Williams. 2008. The missing memristor found. nature 453, 7191 (2008), 80\u201383."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2017.2731776"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/3386691.3386708"},{"key":"e_1_2_1_10_1","first-page":"55","article-title":"Unexpected performance of intel\u00ae optane dc persistent memory","volume":"19","author":"Mason Tony","year":"2020","unstructured":"Tony Mason , Thaleia Dimitra Doudali , Margo Seltzer , and Ada Gavrilovska . 2020 . Unexpected performance of intel\u00ae optane dc persistent memory . IEEE Computer Architecture Letters 19 , 1 (2020), 55 \u2013 58 . Tony Mason, Thaleia Dimitra Doudali, Margo Seltzer, and Ada Gavrilovska. 2020. Unexpected performance of intel\u00ae optane dc persistent memory. IEEE Computer Architecture Letters 19, 1 (2020), 55\u201358.","journal-title":"IEEE Computer Architecture Letters"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2016.2516019"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2592798.2592814"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2063384.2063436"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132770"},{"key":"e_1_2_1_15_1","unstructured":"Mellanox Technologies. RDMA Aware Networks Programming User Manual. Retrieved from https:\/\/docs.mellanox.com\/display\/RDMAAwareProgrammingv17\/RDMA+Aware+Ne tworks+Programming+User+Manual.  Mellanox Technologies. RDMA Aware Networks Programming User Manual. Retrieved from https:\/\/docs.mellanox.com\/display\/RDMAAwareProgrammingv17\/RDMA+Aware+Ne tworks+Programming+User+Manual."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/3154690.3154763"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/3323298.3323319"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2925426.2926290"},{"key":"e_1_2_1_19_1","unstructured":"Brian Beeler. Intel Optane DC Persistent Memory Module (PMM). Retrieved from https:\/\/www.storagereview.com\/news\/intel-optane-dc-persistent-memory-mo dule-pmm.  Brian Beeler. Intel Optane DC Persistent Memory Module (PMM). Retrieved from https:\/\/www.storagereview.com\/news\/intel-optane-dc-persistent-memory-mo dule-pmm."},{"key":"e_1_2_1_20_1","unstructured":"Mellanox Technologies. ConnectX-6 VPI Card. Retrieved from https:\/\/docs.mellanox.com\/display\/ConnectX6VPI.  Mellanox Technologies. ConnectX-6 VPI Card. Retrieved from https:\/\/docs.mellanox.com\/display\/ConnectX6VPI."},{"key":"e_1_2_1_21_1","unstructured":"Intel Corporation. Persistent Memory Replication Over Traditional RDMA. Retrieved from https:\/\/software.intel.com\/content\/www\/us\/en\/develop\/articles\/persisten t-memory-replication-over-traditional-rdma-part-1-understanding-remote-persist ent.html#Durability.  Intel Corporation. Persistent Memory Replication Over Traditional RDMA. Retrieved from https:\/\/software.intel.com\/content\/www\/us\/en\/develop\/articles\/persisten t-memory-replication-over-traditional-rdma-part-1-understanding-remote-persist ent.html#Durability."},{"key":"e_1_2_1_22_1","unstructured":"Intel Corporation. Intel\u00ae Data Direct I\/O Technology. Retrieved from https:\/\/www.intel.com\/content\/www\/us\/en\/io\/data-direct-i-o-technology.h tml.  Intel Corporation. Intel\u00ae Data Direct I\/O Technology. Retrieved from https:\/\/www.intel.com\/content\/www\/us\/en\/io\/data-direct-i-o-technology.h tml."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/2616448.2616486"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPP.2011.37"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2012.141"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/3388242.3388252"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3419111.3421294"},{"key":"e_1_2_1_28_1","first-page":"38","article-title":"Crail: A high-performance I\/O architecture for distributed data processing.IEEE Data","volume":"40","author":"Stuedi Patrick","year":"2017","unstructured":"Patrick Stuedi , Animesh Trivedi , Jonas Pfefferle , Radu Stoica , Bernard Metzler , Nikolas Ioannou , and Ioannis Koltsidas . 2017 . Crail: A high-performance I\/O architecture for distributed data processing.IEEE Data Eng. Bull. 40 , 1 (2017), 38 \u2013 49 . Patrick Stuedi, Animesh Trivedi, Jonas Pfefferle, Radu Stoica, Bernard Metzler, Nikolas Ioannou, and Ioannis Koltsidas. 2017. Crail: A high-performance I\/O architecture for distributed data processing.IEEE Data Eng. Bull. 40, 1 (2017), 38\u201349.","journal-title":"Eng. Bull."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/3358807.3358872"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2670979.2670994"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786763.2694370"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3412852"},{"key":"e_1_2_1_33_1","unstructured":"Linux Kernel Organization. Direct Access for files. Retrieved from https:\/\/www.kernel.org\/doc\/Documentation\/filesystems\/dax.txt.  Linux Kernel Organization. Direct Access for files. Retrieved from https:\/\/www.kernel.org\/doc\/Documentation\/filesystems\/dax.txt."},{"key":"e_1_2_1_34_1","unstructured":"Matthew Wilcox. Add support for NV-DIMMs to ext4. Retrieved from https:\/\/lwn.net\/Articles\/613384\/.  Matthew Wilcox. Add support for NV-DIMMs to ext4. Retrieved from https:\/\/lwn.net\/Articles\/613384\/."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/1973355.1973368"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/944747.944753"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.5555\/3388242.3388251"}],"container-title":["ACM Transactions on Embedded Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477004","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3477004","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:46Z","timestamp":1750188646000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477004"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,22]]},"references-count":37,"journal-issue":{"issue":"5s","published-print":{"date-parts":[[2021,10,31]]}},"alternative-id":["10.1145\/3477004"],"URL":"https:\/\/doi.org\/10.1145\/3477004","relation":{},"ISSN":["1539-9087","1558-3465"],"issn-type":[{"value":"1539-9087","type":"print"},{"value":"1558-3465","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,22]]},"assertion":[{"value":"2021-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-09-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}