{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T23:27:55Z","timestamp":1776295675706,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":102,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,26]],"date-time":"2021-10-26T00:00:00Z","timestamp":1635206400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,26]]},"DOI":"10.1145\/3477132.3483569","type":"proceedings-article","created":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T15:59:18Z","timestamp":1634659158000},"page":"195-211","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":76,"title":["The Demikernel Datapath OS Architecture for Microsecond-scale Datacenter Systems"],"prefix":"10.1145","author":[{"given":"Irene","family":"Zhang","sequence":"first","affiliation":[{"name":"Microsoft Research"}]},{"given":"Amanda","family":"Raybuck","sequence":"additional","affiliation":[{"name":"University of Texas at Austin"}]},{"given":"Pratyush","family":"Patel","sequence":"additional","affiliation":[{"name":"University of Washington"}]},{"given":"Kirk","family":"Olynyk","sequence":"additional","affiliation":[{"name":"Microsoft Research"}]},{"given":"Jacob","family":"Nelson","sequence":"additional","affiliation":[{"name":"Microsoft Research"}]},{"given":"Omar S. Navarro","family":"Leija","sequence":"additional","affiliation":[{"name":"University of Pennsylvania"}]},{"given":"Ashlie","family":"Martinez","sequence":"additional","affiliation":[{"name":"University of Washington"}]},{"given":"Jing","family":"Liu","sequence":"additional","affiliation":[{"name":"University of Wisconsin Madison"}]},{"given":"Anna Kornfeld","family":"Simpson","sequence":"additional","affiliation":[{"name":"University of Washington"}]},{"given":"Sujay","family":"Jayakar","sequence":"additional","affiliation":[{"name":"Zerowatt, Inc."}]},{"given":"Pedro Henrique","family":"Penna","sequence":"additional","affiliation":[{"name":"Microsoft Research"}]},{"given":"Max","family":"Demoulin","sequence":"additional","affiliation":[{"name":"University of Washington"}]},{"given":"Piali","family":"Choudhury","sequence":"additional","affiliation":[{"name":"Microsoft Research"}]},{"given":"Anirudh","family":"Badam","sequence":"additional","affiliation":[{"name":"Microsoft Research"}]}],"member":"320","published-online":{"date-parts":[[2021,10,26]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"9th Biennial Conference on Innovative Data Systems Research CIDR","author":"Alonso G.","year":"2019","unstructured":"Alonso , G. , Binnig , C. , Pandis , I. , Salem , K. , Skrzypczak , J. , Stutsman , R. , Thostrup , L. , Wang , T. , Wang , Z. , and Ziegler , T . DPI: The data processing interface for modern networks . In 9th Biennial Conference on Innovative Data Systems Research CIDR ( 2019 ). Alonso, G., Binnig, C., Pandis, I., Salem, K., Skrzypczak, J., Stutsman, R., Thostrup, L., Wang, T., Wang, Z., and Ziegler, T. DPI: The data processing interface for modern networks. In 9th Biennial Conference on Innovative Data Systems Research CIDR (2019)."},{"key":"e_1_3_2_1_2_1","volume-title":"April","author":"Barak D.","year":"2012","unstructured":"Barak , D. The OFED package , April 2012 . https:\/\/www.rdmamojo.com\/2012\/04\/25\/the-ofed-package\/. Barak, D. The OFED package, April 2012. https:\/\/www.rdmamojo.com\/2012\/04\/25\/the-ofed-package\/."},{"key":"e_1_3_2_1_3_1","volume-title":"11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14)","author":"Belay A.","year":"2014","unstructured":"Belay , A. , Prekas , G. , Klimovic , A. , Grossman , S. , Kozyrakis , C. , and Bugnion , E . IX: A protected dataplane operating system for high throughput and low latency . In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14) ( 2014 ), USENIX Association. Belay, A., Prekas, G., Klimovic, A., Grossman, S., Kozyrakis, C., and Bugnion, E. IX: A protected dataplane operating system for high throughput and low latency. In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14) (2014), USENIX Association."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/378995.379232"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/381694.378821"},{"key":"e_1_3_2_1_6_1","first-page":"7323","author":"Borman D.","year":"2014","unstructured":"Borman , D. , Braden , R. T. , Jacobson , V. , and Scheffenegger , R . TCP Extensions for High Performance. RFC 7323 , 2014 . Borman, D., Braden, R. T., Jacobson, V., and Scheffenegger, R. TCP Extensions for High Performance. RFC 7323, 2014.","journal-title":"TCP Extensions for High Performance. RFC"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3092701"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302424.3303968"},{"key":"e_1_3_2_1_9_1","volume-title":"14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20)","author":"Cho I.","year":"2020","unstructured":"Cho , I. , Saeed , A. , Fried , J. , Park , S. J. , Alizadeh , M. , and Belay , A . Overload control for μs-scale RPCs with Breakwater . In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20) ( 2020 ), USENIX Association. Cho, I., Saeed, A., Fried, J., Park, S. J., Alizadeh, M., and Belay, A. Overload control for μs-scale RPCs with Breakwater. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20) (2020), USENIX Association."},{"key":"e_1_3_2_1_10_1","volume-title":"LWN Articles","year":"2005","unstructured":"corbet. Linux and TCP offload engines . LWN Articles , August 2005 . https:\/\/lwn.net\/Articles\/148697\/. corbet. Linux and TCP offload engines. LWN Articles, August 2005. https:\/\/lwn.net\/Articles\/148697\/."},{"key":"e_1_3_2_1_11_1","volume-title":"Jan","author":"Corbet J.","year":"2019","unstructured":"Corbet , J. Ringing in a new asynchronous I\/O API. lwn.net , Jan 2019 . https:\/\/lwn.net\/Articles\/776703\/. Corbet, J. Ringing in a new asynchronous I\/O API. lwn.net, Jan 2019. https:\/\/lwn.net\/Articles\/776703\/."},{"key":"e_1_3_2_1_12_1","volume-title":"Jan","author":"Corbet J.","year":"2020","unstructured":"Corbet , J. The rapid growth of io_uring. lwn.net , Jan 2020 . https:\/\/lwn.net\/Articles\/810414. Corbet, J. The rapid growth of io_uring. lwn.net, Jan 2020. https:\/\/lwn.net\/Articles\/810414."},{"key":"e_1_3_2_1_13_1","volume-title":"Linux Device Drivers: Where the Kernel Meets the Hardware. \"O'Reilly Media, inc","author":"Corbet J.","year":"2005","unstructured":"Corbet , J. , Rubini , A. , and Kroah-Hartman , G. Linux Device Drivers: Where the Kernel Meets the Hardware. \"O'Reilly Media, inc .\", 2005 . Corbet, J., Rubini, A., and Kroah-Hartman, G. Linux Device Drivers: Where the Kernel Meets the Hardware. \"O'Reilly Media, inc.\", 2005."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1005062.1005069"},{"key":"e_1_3_2_1_15_1","volume-title":"Proceedings of the 26th Symposium on Operating Systems Principles","author":"Demoulin M.","year":"2021","unstructured":"Demoulin , M. , Fried , J. , Pedisich , I. , Kogias , M. , Loo , B. T. , Phan , L. T. X. , and Zhang , I . When idling is ideal: Optimizing taillatency for highly-dispersed datacenter workloads with Persephone . In Proceedings of the 26th Symposium on Operating Systems Principles ( 2021 ), Association for Computing Machinery. Demoulin, M., Fried, J., Pedisich, I., Kogias, M., Loo, B. T., Phan, L. T. X., and Zhang, I. When idling is ideal: Optimizing taillatency for highly-dispersed datacenter workloads with Persephone. In Proceedings of the 26th Symposium on Operating Systems Principles (2021), Association for Computing Machinery."},{"key":"e_1_3_2_1_16_1","unstructured":"Data plane development kit. https:\/\/www.dpdk.org\/.  Data plane development kit. https:\/\/www.dpdk.org\/."},{"key":"e_1_3_2_1_17_1","volume-title":"11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14)","author":"Dragojevi\u0107 A.","year":"2014","unstructured":"Dragojevi\u0107 , A. , Narayanan , D. , Castro , M. , and Hodson , O . FaRM: Fast remote memory . In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14) ( 2014 ), USENIX Association. Dragojevi\u0107, A., Narayanan, D., Castro, M., and Hodson, O. FaRM: Fast remote memory. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14) (2014), USENIX Association."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/224056.224076"},{"key":"e_1_3_2_1_19_1","volume-title":"Proceedings of the BSDCan Conference","author":"Evans J.","year":"2006","unstructured":"Evans , J. A scalable concurrent malloc (3) implementation for FreeBSD . In Proceedings of the BSDCan Conference ( 2006 ). Evans, J. A scalable concurrent malloc (3) implementation for FreeBSD. In Proceedings of the BSDCan Conference (2006)."},{"key":"e_1_3_2_1_20_1","unstructured":"F-Stack. http:\/\/www.f-stack.org\/.  F-Stack. http:\/\/www.f-stack.org\/."},{"key":"e_1_3_2_1_21_1","volume-title":"15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18)","author":"Firestone D.","year":"2018","unstructured":"Firestone , D. , Putnam , A. , Mundkur , S. , Chiou , D. , Dabagh , A. , Andrewartha , M. , Angepat , H. , Bhanu , V. , Caulfield , A. , Chung , E. , Chandrappa , H. K. , Chaturmohta , S. , Humphrey , M. , Lavier , J. , Lam , N. , Liu , F. , Ovtcharov , K. , Padhye , J. , Popuri , G. , Raindel , S. , Sapre , T. , Shaw , M. , Silva , G. , Sivakumar , M. , Srivastava , N. , Verma , A. , Zuhair , Q. , Bansal , D. , Burger , D. , Vaid , K. , Maltz , D. A. , and Greenberg , A . Azure accelerated networking: SmartNICs in the public cloud . In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18) ( 2018 ), USENIX Association. Firestone, D., Putnam, A., Mundkur, S., Chiou, D., Dabagh, A., Andrewartha, M., Angepat, H., Bhanu, V., Caulfield, A., Chung, E., Chandrappa, H. K., Chaturmohta, S., Humphrey, M., Lavier, J., Lam, N., Liu, F., Ovtcharov, K., Padhye, J., Popuri, G., Raindel, S., Sapre, T., Shaw, M., Silva, G., Sivakumar, M., Srivastava, N., Verma, A., Zuhair, Q., Bansal, D., Burger, D., Vaid, K., Maltz, D. A., and Greenberg, A. Azure accelerated networking: SmartNICs in the public cloud. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18) (2018), USENIX Association."},{"key":"e_1_3_2_1_22_1","volume-title":"December","author":"Fleming M.","year":"2017","unstructured":"Fleming , M. A thorough introduction to eBPF. lwn.net , December 2017 . https:\/\/lwn.net\/Articles\/740157\/. Fleming, M. A thorough introduction to eBPF. lwn.net, December 2017. https:\/\/lwn.net\/Articles\/740157\/."},{"key":"e_1_3_2_1_23_1","volume-title":"14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20)","author":"Fried J.","year":"2020","unstructured":"Fried , J. , Ruan , Z. , Ousterhout , A. , and Belay , A . Caladan: Mitigating interference at microsecond timescales . In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20) ( 2020 ), USENIX Association. Fried, J., Ruan, Z., Ousterhout, A., and Belay, A. Caladan: Mitigating interference at microsecond timescales. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20) (2020), USENIX Association."},{"key":"e_1_3_2_1_24_1","unstructured":"File system in user-space. https:\/\/www.kernel.org\/doc\/html\/latest\/filesystems\/fuse.html.  File system in user-space. https:\/\/www.kernel.org\/doc\/html\/latest\/filesystems\/fuse.html."},{"key":"e_1_3_2_1_25_1","unstructured":"A Tour of Go: Channels. https:\/\/tour.golang.org\/concurrency\/2.  A Tour of Go: Channels. https:\/\/tour.golang.org\/concurrency\/2."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1400097.1400105"},{"key":"e_1_3_2_1_27_1","unstructured":"Herbert T. and de Bruijn W. Scaling in the Linux Networking Stack. kernel.org. https:\/\/www.kernel.org\/doc\/Documentation\/networking\/scaling.txt.  Herbert T. and de Bruijn W. Scaling in the Linux Networking Stack. kernel.org. https:\/\/www.kernel.org\/doc\/Documentation\/networking\/scaling.txt."},{"key":"e_1_3_2_1_28_1","volume-title":"15th USENIX Symposium on Networked Systems Design and Implementation (NSD1 18)","author":"Honda M.","year":"2018","unstructured":"Honda , M. , Lettieri , G. , Eggert , L. , and Santry , D . PASTE: A network programming interface for non-volatile main memory . In 15th USENIX Symposium on Networked Systems Design and Implementation (NSD1 18) ( 2018 ), USENIX Association. Honda, M., Lettieri, G., Eggert, L., and Santry, D. PASTE: A network programming interface for non-volatile main memory. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSD1 18) (2018), USENIX Association."},{"key":"e_1_3_2_1_29_1","unstructured":"Internet Engineering Task Force. Traversal Using Relays around NAT. https:\/\/tools.ietf.org\/html\/rfc5766.  Internet Engineering Task Force. Traversal Using Relays around NAT. https:\/\/tools.ietf.org\/html\/rfc5766."},{"key":"e_1_3_2_1_30_1","volume-title":"11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14)","author":"Jeong E.","year":"2014","unstructured":"Jeong , E. , Wood , S. , Jamshed , M. , Jeong , H. , Ihm , S. , Han , D. , and Park , K . mTCP: a highly scalable user-level TCP stack for multicore systems . In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14) ( 2014 ), USENIX Association. Jeong, E., Wood, S., Jamshed, M., Jeong, H., Ihm, S., Han, D., and Park, K. mTCP: a highly scalable user-level TCP stack for multicore systems. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14) (2014), USENIX Association."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA.2017.15"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359631"},{"key":"e_1_3_2_1_33_1","volume-title":"16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19)","author":"Kaffes K.","year":"2019","unstructured":"Kaffes , K. , Chong , T. , Humphries , J. T. , Belay , A. , Mazi\u00e8res , D. , and Kozyrakis , C . Shinjuku: Preemptive scheduling for μsecond-scale tail latency . In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19) ( 2019 ), USENIX Association. Kaffes, K., Chong, T., Humphries, J. T., Belay, A., Mazi\u00e8res, D., and Kozyrakis, C. Shinjuku: Preemptive scheduling for μsecond-scale tail latency. In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19) (2019), USENIX Association."},{"key":"e_1_3_2_1_34_1","volume-title":"16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19)","author":"Kalia A.","year":"2019","unstructured":"Kalia , A. , Kaminsky , M. , and Andersen , D . Datacenter RPCs can be general and fast . In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19) ( 2019 ), USENIX Association. Kalia, A., Kaminsky, M., and Andersen, D. Datacenter RPCs can be general and fast. In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19) (2019), USENIX Association."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740070.2626299"},{"key":"e_1_3_2_1_36_1","volume-title":"2016 USENIX Annual Technical Conference (USENIX ATC 16)","author":"Kalia A.","year":"2016","unstructured":"Kalia , A. , Kaminsky , M. , and Andersen , D. G . Design guidelines for high performance RDMA systems . In 2016 USENIX Annual Technical Conference (USENIX ATC 16) ( 2016 ), USENIX Association. Kalia, A., Kaminsky, M., and Andersen, D. G. Design guidelines for high performance RDMA systems. In 2016 USENIX Annual Technical Conference (USENIX ATC 16) (2016), USENIX Association."},{"key":"e_1_3_2_1_37_1","volume-title":"12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16)","author":"Kalia A.","year":"2016","unstructured":"Kalia , A. , Kaminsky , M. , and Andersen , D. G . FaSST: Fast, scalable and simple distributed transactions with two-sided RDMA datagram RPCs . In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) ( 2016 ), USENIX Association. Kalia, A., Kaminsky, M., and Andersen, D. G. FaSST: Fast, scalable and simple distributed transactions with two-sided RDMA datagram RPCs. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) (2016), USENIX Association."},{"key":"e_1_3_2_1_38_1","unstructured":"Kallas S. Turn server. Github. https:\/\/github.com\/seemk\/urn.  Kallas S. Turn server. Github. https:\/\/github.com\/seemk\/urn."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302424.3303985"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3230543.3230572"},{"key":"e_1_3_2_1_41_1","volume-title":"8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage 16)","author":"Kim H.-J.","year":"2016","unstructured":"Kim , H.-J. , Lee , Y.-S. , and Kim , J . -S. NVMeDirect: A user-space I\/O framework for application-specific optimization on NVMe SSDs . In 8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage 16) ( 2016 ), USENIX Association. Kim, H.-J., Lee, Y.-S., and Kim, J.-S. NVMeDirect: A user-space I\/O framework for application-specific optimization on NVMe SSDs. In 8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage 16) (2016), USENIX Association."},{"key":"e_1_3_2_1_42_1","volume-title":"Building efficient I\/O intensive applications with Seastar","author":"Kivity A.","year":"2019","unstructured":"Kivity , A. Building efficient I\/O intensive applications with Seastar , 2019 . https:\/\/github.com\/CoreCppIL\/CoreCpp2019\/blob\/master\/Presentations\/Avi_Building_efficient_IO_intensive_applications_with_Seastar.pdf. Kivity, A. Building efficient I\/O intensive applications with Seastar, 2019. https:\/\/github.com\/CoreCppIL\/CoreCpp2019\/blob\/master\/Presentations\/Avi_Building_efficient_IO_intensive_applications_with_Seastar.pdf."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3037697.3037732"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132770"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3295500.3356176"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-34175-6_13"},{"key":"e_1_3_2_1_47_1","volume-title":"Feb","author":"Lemire D.","year":"2018","unstructured":"Lemire , D. Iterating over set bits quickly , Feb 2018 . https:\/\/lemire.me\/blog\/2018\/02\/21\/iterating-over-set-bits-quickly\/. Lemire, D. Iterating over set bits quickly, Feb 2018. https:\/\/lemire.me\/blog\/2018\/02\/21\/iterating-over-set-bits-quickly\/."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11390-005-0654-4"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/49.536480"},{"key":"e_1_3_2_1_50_1","volume-title":"LWN Articles","author":"Lesokhin I.","year":"2017","unstructured":"Lesokhin , I. tls : Add generic NIC offload infrastructure . LWN Articles , September 2017 . https:\/\/lwn.net\/Articles\/734030. Lesokhin, I. tls: Add generic NIC offload infrastructure. LWN Articles, September 2017. https:\/\/lwn.net\/Articles\/734030."},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341302.3342071"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132756"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2670979.2670988"},{"key":"e_1_3_2_1_54_1","unstructured":"libevent: an event notification library. http:\/\/libevent.org\/.  libevent: an event notification library. http:\/\/libevent.org\/."},{"key":"e_1_3_2_1_55_1","volume-title":"Aug","author":"Mandry T.","year":"2019","unstructured":"Mandry , T. How Rust optimizes async\/await I , Aug 2019 . https:\/\/tmandry.gitlab.io\/blog\/posts\/optimizing-await-1\/. Mandry, T. How Rust optimizes async\/await I, Aug 2019. https:\/\/tmandry.gitlab.io\/blog\/posts\/optimizing-await-1\/."},{"key":"e_1_3_2_1_56_1","volume-title":"Feb","author":"Marek","year":"2017","unstructured":"Marek . Epoll is fundamentally broken 1\/2 , Feb 2017 . https:\/\/idea.popcount.org\/2017-02-20-epoll-is-fundamentally-broken-12\/. Marek. Epoll is fundamentally broken 1\/2, Feb 2017. https:\/\/idea.popcount.org\/2017-02-20-epoll-is-fundamentally-broken-12\/."},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359657"},{"key":"e_1_3_2_1_58_1","unstructured":"Mellanox. BlueField Smart NIC. http:\/\/www.mellanox.com\/page\/products_dyn?product_family=275&mtag=bluefield_smart_nic1.  Mellanox. BlueField Smart NIC. http:\/\/www.mellanox.com\/page\/products_dyn?product_family=275&mtag=bluefield_smart_nic1."},{"key":"e_1_3_2_1_59_1","unstructured":"Mellanox. Mellanox OFED for Linux User Manual. https:\/\/www.mellanox.com\/related-docs\/prod_software\/Mellanox_OFED_Linux_User_Manual_v4.1.pdf.  Mellanox. Mellanox OFED for Linux User Manual. https:\/\/www.mellanox.com\/related-docs\/prod_software\/Mellanox_OFED_Linux_User_Manual_v4.1.pdf."},{"key":"e_1_3_2_1_60_1","first-page":"3","article-title":"An introduction to smart NICs","author":"Mellanox","year":"2019","unstructured":"Mellanox . An introduction to smart NICs . The Next Platform , 3 2019 . https:\/\/www.nextplatform.com\/2019\/03\/04\/an-introduction-to-smartnics\/. Mellanox. An introduction to smart NICs. The Next Platform, 3 2019. https:\/\/www.nextplatform.com\/2019\/03\/04\/an-introduction-to-smartnics\/.","journal-title":"The Next Platform"},{"key":"e_1_3_2_1_61_1","volume-title":"April","author":"Mellanox","year":"2019","unstructured":"Mellanox . Mellanox OFED RDMA libraries , April 2019 . http:\/\/www.mellanox.com\/page\/mlnx_ofed_public_repository. Mellanox. Mellanox OFED RDMA libraries, April 2019. http:\/\/www.mellanox.com\/page\/mlnx_ofed_public_repository."},{"key":"e_1_3_2_1_62_1","volume-title":"September","author":"Mellanox","year":"2020","unstructured":"Mellanox . RDMA Aware Networks Programming User Manual , September 2020 . https:\/\/community.mellanox.com\/s\/article\/rdma-aware-networks-programming--160--user-manual. Mellanox. RDMA Aware Networks Programming User Manual, September 2020. https:\/\/community.mellanox.com\/s\/article\/rdma-aware-networks-programming--160--user-manual."},{"key":"e_1_3_2_1_63_1","volume-title":"July","author":"Microsoft","year":"2010","unstructured":"Microsoft . Network Direct SPI Reference, v2 ed ., July 2010 . https:\/\/docs.microsoft.com\/en-us\/previous-versions\/windows\/desktop\/cc904391(v%3Dvs.85). Microsoft. Network Direct SPI Reference, v2 ed., July 2010. https:\/\/docs.microsoft.com\/en-us\/previous-versions\/windows\/desktop\/cc904391(v%3Dvs.85)."},{"key":"e_1_3_2_1_64_1","volume-title":"2013 USENIX Annual Technical Conference (USENIX ATC 13)","author":"Mitchell C.","year":"2013","unstructured":"Mitchell , C. , Geng , Y. , and Li , J . Using one-sided RDMA reads to build a fast, CPU-Efficient key-value store . In 2013 USENIX Annual Technical Conference (USENIX ATC 13) ( 2013 ), USENIX Association. Mitchell, C., Geng, Y., and Li, J. Using one-sided RDMA reads to build a fast, CPU-Efficient key-value store. In 2013 USENIX Annual Technical Conference (USENIX ATC 13) (2013), USENIX Association."},{"key":"e_1_3_2_1_65_1","volume-title":"9th Workshop on Hot Topics in Operating Systems (HotOS IX)","author":"Mogul J. C.","year":"2003","unstructured":"Mogul , J. C. TCP offload is a dumb idea whose time has come . In 9th Workshop on Hot Topics in Operating Systems (HotOS IX) ( 2003 ), USENIX Association. Mogul, J. C. TCP offload is a dumb idea whose time has come. In 9th Workshop on Hot Topics in Operating Systems (HotOS IX) (2003), USENIX Association."},{"key":"e_1_3_2_1_66_1","volume-title":"17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20)","author":"Moon Y.","year":"2020","unstructured":"Moon , Y. , Lee , S. , Jamshed , M. A. , and Park , K . AccelTCP: Accelerating network applications with stateful TCP offloading . In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20) ( 2020 ), USENIX Association. Moon, Y., Lee, S., Jamshed, M. A., and Park, K. AccelTCP: Accelerating network applications with stateful TCP offloading. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20) (2020), USENIX Association."},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3152434.3152438"},{"key":"e_1_3_2_1_68_1","unstructured":"Network Protocol Independent Performance Evaluator. https:\/\/linux.die.net\/man\/1\/netpipe.  Network Protocol Independent Performance Evaluator. https:\/\/linux.die.net\/man\/1\/netpipe."},{"key":"e_1_3_2_1_69_1","unstructured":"Netronome. Agilio CX SmartNICs. https:\/\/www.netronome.com\/products\/agilio-cx\/.  Netronome. Agilio CX SmartNICs. https:\/\/www.netronome.com\/products\/agilio-cx\/."},{"key":"e_1_3_2_1_70_1","unstructured":"OpenFabrics Interfaces Working Group. RSockets. GitHub. https:\/\/github.com\/ofiwg\/librdmacm\/blob\/master\/docs\/rsocket.  OpenFabrics Interfaces Working Group. RSockets. GitHub. https:\/\/github.com\/ofiwg\/librdmacm\/blob\/master\/docs\/rsocket."},{"key":"e_1_3_2_1_71_1","volume-title":"16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19)","author":"Ousterhout A.","year":"2019","unstructured":"Ousterhout , A. , Fried , J. , Behrens , J. , Belay , A. , and Balakrishnan , H . Shenango: Achieving high CPU efficiency for latency-sensitive datacenter workloads . In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19) ( 2019 ), USENIX Association. Ousterhout, A., Fried, J., Behrens, J., Belay, A., and Balakrishnan, H. Shenango: Achieving high CPU efficiency for latency-sensitive datacenter workloads. In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19) (2019), USENIX Association."},{"key":"e_1_3_2_1_72_1","volume-title":"12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16)","author":"Panda A.","year":"2016","unstructured":"Panda , A. , Han , S. , Jang , K. , Walls , M. , Ratnasamy , S. , and Shenker , S . Netbricks: Taking the V out of NFV . In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) ( 2016 ), USENIX Association. Panda, A., Han, S., Jang, K., Walls, M., Ratnasamy, S., and Shenker, S. Netbricks: Taking the V out of NFV. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) (2016), USENIX Association."},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2812806"},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/1950365.1950399"},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132780"},{"key":"e_1_3_2_1_76_1","unstructured":"Protocol buffers. https:\/\/developers.google.com\/protocol-buffers\/.  Protocol buffers. https:\/\/developers.google.com\/protocol-buffers\/."},{"key":"e_1_3_2_1_77_1","volume-title":"9th RoEduNet IEEE International Conference","author":"Purdila O.","year":"2010","unstructured":"Purdila , O. , Grijincu , L. A. , and Tapus , N . LKL: The linux kernel library . In 9th RoEduNet IEEE International Conference ( 2010 ), IEEE. Purdila, O., Grijincu, L. A., and Tapus, N. LKL: The linux kernel library. In 9th RoEduNet IEEE International Conference (2010), IEEE."},{"key":"e_1_3_2_1_78_1","volume-title":"October","author":"RDMA Consortium","year":"2002","unstructured":"RDMA Consortium . A RDMA protocol specification , October 2002 . http:\/\/rdmaconsortium.org\/. RDMA Consortium. A RDMA protocol specification, October 2002. http:\/\/rdmaconsortium.org\/."},{"key":"e_1_3_2_1_79_1","unstructured":"RDMA communication manager. https:\/\/linux.die.net\/man\/7\/rdma_cm.  RDMA communication manager. https:\/\/linux.die.net\/man\/7\/rdma_cm."},{"key":"e_1_3_2_1_80_1","volume-title":"Open source data structure server","author":"Redis","year":"2013","unstructured":"Redis : Open source data structure server , 2013 . http:\/\/redis.io\/. Redis: Open source data structure server, 2013. http:\/\/redis.io\/."},{"key":"e_1_3_2_1_81_1","volume-title":"14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20)","author":"Ren Y.","year":"2020","unstructured":"Ren , Y. , Min , C. , and Kannan , S . CrossFS: A cross-layered direct-access file system . In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20) ( 2020 ), USENIX Association. Ren, Y., Min, C., and Kannan, S. CrossFS: A cross-layered direct-access file system. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20) (2020), USENIX Association."},{"key":"e_1_3_2_1_82_1","first-page":"793","author":"Transmission Control Protocol","year":"1981","unstructured":"Transmission Control Protocol . RFC 793 , 1981 . https:\/\/tools.ietf.org\/html\/rfc793. Transmission Control Protocol. RFC 793, 1981. https:\/\/tools.ietf.org\/html\/rfc793.","journal-title":"RFC"},{"key":"e_1_3_2_1_83_1","volume-title":"2012 USENIX Annual Technical Conference (USENIX ATC 12)","author":"Rizzo L.","year":"2012","unstructured":"Rizzo , L. Netmap : A novel framework for fast packet I\/O . In 2012 USENIX Annual Technical Conference (USENIX ATC 12) ( 2012 ), USENIX Association. Rizzo, L. Netmap: A novel framework for fast packet I\/O. In 2012 USENIX Annual Technical Conference (USENIX ATC 12) (2012), USENIX Association."},{"key":"e_1_3_2_1_84_1","unstructured":"RDMA CM connection and RDMA ping-pong test. http:\/\/manpages.ubuntu.com\/manpages\/bionic\/man1\/rping.1.html.  RDMA CM connection and RDMA ping-pong test. http:\/\/manpages.ubuntu.com\/manpages\/bionic\/man1\/rping.1.html."},{"key":"e_1_3_2_1_85_1","unstructured":"Rust. The Async Book. https:\/\/rust-lang.github.io\/async-book\/.  Rust. The Async Book. https:\/\/rust-lang.github.io\/async-book\/."},{"key":"e_1_3_2_1_86_1","volume-title":"11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14)","author":"Seshadri S.","year":"2014","unstructured":"Seshadri , S. , Gahagan , M. , Bhaskaran , S. , Bunker , T. , De , A. , Jin , Y. , Liu , Y. , and Swanson , S . Willow: A user-programmable SSD . In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14) ( 2014 ), USENIX Association. Seshadri, S., Gahagan, M., Bhaskaran, S., Bunker, T., De, A., Jin, Y., Liu, Y., and Swanson, S. Willow: A user-programmable SSD. In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14) (2014), USENIX Association."},{"key":"e_1_3_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1109\/MRD.1990.138237"},{"key":"e_1_3_2_1_88_1","unstructured":"Storage performance development kit. https:\/\/spdk.io\/.  Storage performance development kit. https:\/\/spdk.io\/."},{"key":"e_1_3_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.5555\/1558977.1558981"},{"key":"e_1_3_2_1_90_1","volume-title":"Proceedings of the Conference of the ACM Special Interest Group on Data Communication","author":"Bi J.","year":"2017","unstructured":"SUN, C., Bi , J. , Zheng , Z. , Yu , H. , and Hu , H . NFP: Enabling network function parallelism in NFV . In Proceedings of the Conference of the ACM Special Interest Group on Data Communication ( 2017 ), Association for Computing Machinery. SUN, C., Bi, J., Zheng, Z., Yu, H., and Hu, H. NFP: Enabling network function parallelism in NFV. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (2017), Association for Computing Machinery."},{"key":"e_1_3_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/1133373.1133393"},{"key":"e_1_3_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/3190508.3190536"},{"key":"e_1_3_2_1_93_1","unstructured":"Testpmd Users Guide. https:\/\/doc.dpdk.org\/guides\/testpmd_app_ug\/.  Testpmd Users Guide. https:\/\/doc.dpdk.org\/guides\/testpmd_app_ug\/."},{"key":"e_1_3_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447786.3456255"},{"key":"e_1_3_2_1_95_1","volume-title":"15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18)","author":"Tootoonchian A.","year":"2018","unstructured":"Tootoonchian , A. , Panda , A. , Lan , C. , Walls , M. , Argyraki , K. , Ratnasamy , S. , and Shenker , S . ResQ: Enabling SLOs in network function virtualization . In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18) ( 2018 ), USENIX Association. Tootoonchian, A., Panda, A., Lan, C., Walls, M., Argyraki, K., Ratnasamy, S., and Shenker, S. ResQ: Enabling SLOs in network function virtualization. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18) (2018), USENIX Association."},{"key":"e_1_3_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1145\/3239562"},{"key":"e_1_3_2_1_97_1","volume-title":"Sep","author":"Turon A.","year":"2016","unstructured":"Turon , A. Designing futures for Rust , Sep 2016 . https:\/\/aturon.github.io\/blog\/2016\/09\/07\/futures-design\/. Turon, A. Designing futures for Rust, Sep 2016. https:\/\/aturon.github.io\/blog\/2016\/09\/07\/futures-design\/."},{"key":"e_1_3_2_1_98_1","volume-title":"Deconstructing RDMA-enabled distributed transactions: Hybrid is better! In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18)","author":"Wei X.","year":"2018","unstructured":"Wei , X. , Dong , Z. , Chen , R. , and Chen , H . Deconstructing RDMA-enabled distributed transactions: Hybrid is better! In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18) ( 2018 ), USENIX Association . Wei, X., Dong, Z., Chen, R., and Chen, H. Deconstructing RDMA-enabled distributed transactions: Hybrid is better! In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18) (2018), USENIX Association."},{"key":"e_1_3_2_1_100_1","volume-title":"May","author":"WIKIPEDIA.","year":"2021","unstructured":"WIKIPEDIA. Traversal Using Relays around NAT , May 2021 . https:\/\/en.wikipedia.org\/wiki\/Traversal_Using_Relays_around_NAT. WIKIPEDIA. Traversal Using Relays around NAT, May 2021. https:\/\/en.wikipedia.org\/wiki\/Traversal_Using_Relays_around_NAT."},{"key":"e_1_3_2_1_101_1","volume-title":"17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20)","author":"Yang J.","year":"2020","unstructured":"Yang , J. , Izraelevitz , J. , and Swanson , S . FileMR: Rethinking RDMA networking for scalable persistent memory . In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20) ( 2020 ), USENIX Association. Yang, J., Izraelevitz, J., and Swanson, S. FileMR: Rethinking RDMA networking for scalable persistent memory. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20) (2020), USENIX Association."},{"key":"e_1_3_2_1_102_1","volume-title":"2016 USENIX Annual Technical Conference (USENIX ATC 16)","author":"Yasukata K.","year":"2016","unstructured":"Yasukata , K. , Honda , M. , Santry , D. , and Eggert , L . Stackmap: Low-latency networking with the OS stack and dedicated NICs . In 2016 USENIX Annual Technical Conference (USENIX ATC 16) ( 2016 ), USENIX Association. Yasukata, K., Honda, M., Santry, D., and Eggert, L. Stackmap: Low-latency networking with the OS stack and dedicated NICs. In 2016 USENIX Annual Technical Conference (USENIX ATC 16) (2016), USENIX Association."},{"key":"e_1_3_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269981"}],"event":{"name":"SOSP '21: ACM SIGOPS 28th Symposium on Operating Systems Principles","location":"Virtual Event Germany","acronym":"SOSP '21","sponsor":["SIGOPS ACM Special Interest Group on Operating Systems","USENIX Assoc USENIX Assoc"]},"container-title":["Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477132.3483569","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3477132.3483569","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:49:16Z","timestamp":1750193356000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477132.3483569"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,26]]},"references-count":102,"alternative-id":["10.1145\/3477132.3483569","10.1145\/3477132"],"URL":"https:\/\/doi.org\/10.1145\/3477132.3483569","relation":{},"subject":[],"published":{"date-parts":[[2021,10,26]]},"assertion":[{"value":"2021-10-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}