{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,21]],"date-time":"2025-11-21T11:31:56Z","timestamp":1763724716664,"version":"3.41.0"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,1,15]],"date-time":"2024-01-15T00:00:00Z","timestamp":1705276800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSF","award":["CNS-2011252"],"award-info":[{"award-number":["CNS-2011252"]}]},{"name":"An Intel grant"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Model. Perform. Eval. Comput. Syst."],"published-print":{"date-parts":[[2024,3,31]]},"abstract":"<jats:p>Modern data center storage systems are invariably networked to allow for consolidation and flexible management of storage. They also include high-performance storage devices based on flash or other emerging technologies, generally accessed through low-latency and high-throughput protocols such as Non-volatile Memory Express (NVMe) (or its derivatives) carried over the network. With the increasing complexity and data-centric nature of the applications, properly configuring the quality of service (QoS) for the storage path has become crucial for ensuring the desired application performance. Such QoS is substantially influenced by the QoS in the network path, in the access protocol, and in the storage device. In this article, we define a new transport-level QoS mechanism for the network segment and demonstrate how it can augment and coordinate with the access-level QoS mechanism defined for NVMe, and a similar QoS mechanism configured in the device. We show that the transport QoS mechanism not only provides the desired QoS to different classes of storage accesses but is also able to protect the access to the shared persistent memory devices located along with the storage but requiring much lower latency than storage. We demonstrate that a proper coordinated configuration of the three QoS\u2019s on the path is crucial to achieve the desired differentiation, depending on where the bottlenecks appear.<\/jats:p>","DOI":"10.1145\/3631606","type":"journal-article","created":{"date-parts":[[2023,11,10]],"date-time":"2023-11-10T11:36:59Z","timestamp":1699616219000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Configuring and Coordinating End-to-end QoS for Emerging Storage Infrastructure"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3204-6612","authenticated-orcid":false,"given":"Jit","family":"Gupta","sequence":"first","affiliation":[{"name":"Computer and Information Sciences, Temple University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5743-9944","authenticated-orcid":false,"given":"Krishna","family":"Kant","sequence":"additional","affiliation":[{"name":"Computer and Information Sciences, Temple University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5478-4590","authenticated-orcid":false,"given":"Amitangshu","family":"Pal","sequence":"additional","affiliation":[{"name":"Computer Science and Engineering, Indian Institute of Technology Kanpur, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3725-2212","authenticated-orcid":false,"given":"Joyanta","family":"Biswas","sequence":"additional","affiliation":[{"name":"Computer and Information Sciences, Temple University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,1,15]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBDATA.2020.3036813"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/1851275.1851192"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/1851182.1851192"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/1993744.1993753"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.17487\/RFC8257"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/LCN52139.2021.9524967"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3012426.3022184"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3098822.3098840"},{"key":"e_1_3_2_10_2","unstructured":"D. Cobb and A. Huffman. 2012. Nvm Express and the PCI express SSD Revolution. Intel Developer Forum."},{"key":"e_1_3_2_11_2","article-title":"The Network is the New Storage Bottleneck","author":"Davis Rob","year":"2016","unstructured":"Rob Davis. 2016. The Network is the New Storage Bottleneck. Retrieved fromhttps:\/\/www.datanami.com\/2016\/11\/10\/network-new-storage-bottleneck\/.","journal-title":"Retrieved from"},{"key":"e_1_3_2_12_2","unstructured":"Kevin Deierling. 2016. Convergence of Storage and Memory. https:\/\/www.snia.org\/sites\/default\/files\/NVM\/2016\/presentations\/NVMSummitMellanox_Final.pdf"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2012.120"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2312005.2312040"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.5555\/2342806.2342812"},{"key":"e_1_3_2_16_2","unstructured":"Paul Grun Stephen Bates and Rob Davis. 2018. Persistent Memory Over Fabrics.https:\/\/www.snia.org\/sites\/default\/files\/PM-Summit\/2018\/presentations\/05_PM_Summit_Grun_PM_%20Final_Post_CORRECTED.pdf"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/UCC.2018.00033"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/CloudCom49646.2020.00010"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2014.21"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/2342356.2342389"},{"key":"e_1_3_2_21_2","volume-title":"Introduction to Computer System Performance Evaluation","author":"Kant Krishna","year":"1992","unstructured":"Krishna Kant. 1992. Introduction to Computer System Performance Evaluation. McGraw-Hill, New York, NY."},{"key":"e_1_3_2_22_2","unstructured":"Swaroop Kavalanekar and Bruce Worthington. 2007. Microsoft Enterprise Traces (SNIA IOTTA Trace 130). Retrieved from http:\/\/iotta.snia.org\/traces\/130"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3385209.3385221"},{"key":"e_1_3_2_24_2","first-page":"17","volume-title":"Proceedings of the 10th USENIX Conference on Hot Topics in Storage and File Systems (HotStorage\u201918)","author":"Kim Taejin","year":"2018","unstructured":"Taejin Kim, Sangwook Shane Hahn, Sungjin Lee, Jooyoung Hwang, Jongyoul Lee, and Jihong Kim. 2018. PCStream: Automatic stream allocation using program contexts. In Proceedings of the 10th USENIX Conference on Hot Topics in Storage and File Systems (HotStorage\u201918). USENIX Association, 17."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.5555\/3323298.3323326"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3037697.3037732"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/2043556.2043563"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3230543.3230564"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/INFCOM.2013.6567018"},{"key":"e_1_3_2_30_2","unstructured":"NVMe 2019. NVM Express Base Specification Rev 1.4. Retrieved from https:\/\/nvmexpress.org\/wp-content\/uploads\/NVM-Express-1_4-2019.06.10-Ratified.pdf"},{"key":"e_1_3_2_31_2","unstructured":"NVMeOF 2019. NVM Express over Fabrics Revision 1.1. Retrieved from https:\/\/nvmexpress.org\/wp-content\/uploads\/NVMe-over-Fabrics-1.1-2019.10.22-Ratified.pdf"},{"key":"e_1_3_2_32_2","unstructured":"R 2022 The OpenSSD Project"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3350755.3400273"},{"key":"e_1_3_2_34_2","unstructured":"SNIA Iotta Trace Repository. 07.15.2020. Systor\u201917 Fujitsu Laboratory Traces. Retrieved from http:\/\/iotta.snia.org\/traces\/4964"},{"key":"e_1_3_2_35_2","first-page":"257","volume-title":"Proceedings of the 16th USENIX Conference on File and Storage Technologies (FAST\u201918)","author":"Rho Eunhee","year":"2018","unstructured":"Eunhee Rho, Kanchan Joshi, Seung-Uk Shin, Nitesh Jagadeesh Shetty, Joo-Young Hwang, Sangyeun Cho, Daniel D. G. Lee, and Jaeheon Jeong. 2018. FStream: Managing flash streams in the file system. In Proceedings of the 16th USENIX Conference on File and Storage Technologies (FAST\u201918). USENIX Association, 257\u2013263."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12331-3_2"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/NCA53618.2021.9685772"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/NAS51552.2021.9605470"},{"key":"e_1_3_2_39_2","article-title":"The Samsung 970 EVO Plus (250GB, 1TB) NVMe SSD Review","author":"Tallis Billy","year":"2019","unstructured":"Billy Tallis. 2019. The Samsung 970 EVO Plus (250GB, 1TB) NVMe SSD Review. Retrieved from https:\/\/www.anandtech.com\/show\/13761\/the-samsung-970-evo-plus-ssd-review\/5","journal-title":"R"},{"key":"e_1_3_2_40_2","first-page":"49","volume-title":"Proceedings of the 16th USENIX Conference on File and Storage Technologies (FAST\u201918)","author":"Tavakkol Arash","year":"2018","unstructured":"Arash Tavakkol, Juan G\u00f3mez-Luna, Mohammad Sadrosadati, Saugata Ghose, and Onur Mutlu. 2018. MQsim: A framework for enabling realistic studies of modern multi-queue SSD devices. In Proceedings of the 16th USENIX Conference on File and Storage Technologies (FAST\u201918). USENIX Association, 49\u201365."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/2342356.2342388"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.4108\/ICST.SIMUTOOLS2008.3027"},{"key":"e_1_3_2_43_2","volume-title":"Introduction to Thor Congestion Control for RoCE","author":"Voloshin Moshe","year":"2022","unstructured":"Moshe Voloshin. 2022. Introduction to Thor Congestion Control for RoCE. Technical Report."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/2018436.2018443"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/2043164.2018443"},{"key":"e_1_3_2_46_2","first-page":"207","volume-title":"Proceedings of the 17th USENIX Conference on File and Storage Technologies (FAST\u201919)","author":"Zheng Shengan","year":"2019","unstructured":"Shengan Zheng, Morteza Hoseinzadeh, and Steven Swanson. 2019. Ziggurat: A tiered file system for non-volatile main memories and disks. In Proceedings of the 17th USENIX Conference on File and Storage Technologies (FAST\u201919). USENIX Association, 207\u2013219."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/2987550.2987585"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/2670979.2671008"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/2829988.2787484"}],"container-title":["ACM Transactions on Modeling and Performance Evaluation of Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631606","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3631606","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:03:53Z","timestamp":1750291433000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631606"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,15]]},"references-count":48,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,3,31]]}},"alternative-id":["10.1145\/3631606"],"URL":"https:\/\/doi.org\/10.1145\/3631606","relation":{},"ISSN":["2376-3639","2376-3647"],"issn-type":[{"type":"print","value":"2376-3639"},{"type":"electronic","value":"2376-3647"}],"subject":[],"published":{"date-parts":[[2024,1,15]]},"assertion":[{"value":"2023-06-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-29","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-01-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}