{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,25]],"date-time":"2025-12-25T12:38:27Z","timestamp":1766666307733,"version":"3.41.0"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2017,10,25]],"date-time":"2017-10-25T00:00:00Z","timestamp":1508889600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGCOMM Comput. Commun. Rev."],"published-print":{"date-parts":[[2017,10,25]]},"abstract":"<jats:p>Datacenter-networking research requires tools to both generate traffic and accurately measure latency and throughput. While hardware-based tools have long existed commercially, they are primarily used to validate ASICs and lack flexibility, e.g. to study new protocols. They are also too expensive for academics. The recent development of kernel-bypass networking and advanced NIC features such as hardware timestamping have created new opportunities for accurate latency measurements. This paper compares these two approaches, and in particular whether commodity servers and NICs, when properly configured, can measure the latency distributions as precisely as specialized hardware.<\/jats:p>\n          <jats:p>Our work shows that well-designed commodity solutions can capture subtle differences in the tail latency of stateless UDP traffic. We use hardware devices as the ground truth, both to measure latency and to forward traffic. We compare the ground truth with observations that combine five latency-measuring clients and five different port forwarding solutions and configurations. State-of-the-art software such as MoonGen that uses NIC hardware timestamping provides sufficient visibility into tail latencies to study the effect of subtle operating system configuration changes. We also observe that the kernel-bypass-based TRex software, that only relies on the CPU to timestamp traffic, can also provide solid results when NIC timestamps are not available for a particular protocol or device.<\/jats:p>","DOI":"10.1145\/3155055.3155065","type":"journal-article","created":{"date-parts":[[2017,10,26]],"date-time":"2017-10-26T14:19:33Z","timestamp":1509027573000},"page":"61-66","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["How to Measure the Killer Microsecond"],"prefix":"10.1145","volume":"47","author":[{"given":"Mia","family":"Primorac","sequence":"first","affiliation":[{"name":"EPFL"}]},{"given":"Edouard","family":"Bugnion","sequence":"additional","affiliation":[{"name":"EPFL"}]},{"given":"Katerina","family":"Argyraki","sequence":"additional","affiliation":[{"name":"EPFL"}]}],"member":"320","published-online":{"date-parts":[[2017,10,25]]},"reference":[{"key":"e_1_2_1_1_2","unstructured":"Data Plane Development Kit. http:\/\/dpdk.org\/. Last accessed: 2017-03-01.  Data Plane Development Kit. http:\/\/dpdk.org\/. Last accessed: 2017-03-01."},{"key":"e_1_2_1_2_2","unstructured":"Netperf. http:\/\/www.netperf.org\/netperf\/. Last accessed: 2017-03-08.  Netperf. http:\/\/www.netperf.org\/netperf\/. Last accessed: 2017-03-08."},{"key":"e_1_2_1_3_2","unstructured":"Solarflare Flareon Ultra SFN8522-PLUS. https:\/\/www.solarflare.com\/Media\/Default\/PDFs\/SF-116323-CD-LATEST_Solarflare_SFN8522-PLUS_Product_Brief.pdf.  Solarflare Flareon Ultra SFN8522-PLUS. https:\/\/www.solarflare.com\/Media\/Default\/PDFs\/SF-116323-CD-LATEST_Solarflare_SFN8522-PLUS_Product_Brief.pdf."},{"volume-title":"https:\/\/github.com\/MihaelaMia\/measure-killer-us","year":"2017","key":"e_1_2_1_4_2","unstructured":"Repository. https:\/\/github.com\/MihaelaMia\/measure-killer-us , 2017 . Repository. https:\/\/github.com\/MihaelaMia\/measure-killer-us, 2017."},{"key":"e_1_2_1_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3015146"},{"key":"e_1_2_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2010.5560600"},{"key":"e_1_2_1_7_2","volume-title":"Benchmarking Methodology for Network Interconnect Devices. IETF RFC","author":"Bradner S.","year":"1999","unstructured":"S. Bradner and J. McQuaid . Benchmarking Methodology for Network Interconnect Devices. IETF RFC 2544, Mar. 1999 . S. Bradner and J. McQuaid. Benchmarking Methodology for Network Interconnect Devices. IETF RFC 2544, Mar. 1999."},{"key":"e_1_2_1_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3009824"},{"key":"e_1_2_1_9_2","unstructured":"Cisco Systems. Cisco SG500X-48 48-Port GB with 4-Port 10-GB Stackable Managed Switch.  Cisco Systems. Cisco SG500X-48 48-Port GB with 4-Port 10-GB Stackable Managed Switch."},{"key":"e_1_2_1_10_2","unstructured":"Cisco Systems. TRex: Cisco's realistic traffic generator. https:\/\/trex-tgn.cisco.com. Last accessed: 2017-03-01.  Cisco Systems. TRex: Cisco's realistic traffic generator. https:\/\/trex-tgn.cisco.com. Last accessed: 2017-03-01."},{"key":"e_1_2_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/SFICON.2002.1159815"},{"key":"e_1_2_1_12_2","unstructured":"P. Emmerich. Moongen's GitHub repository (commit ef3aa3f). https:\/\/github.com\/emmericp\/MoonGen. Last accessed: 2017-03-01.  P. Emmerich. Moongen's GitHub repository (commit ef3aa3f). https:\/\/github.com\/emmericp\/MoonGen. Last accessed: 2017-03-01."},{"key":"e_1_2_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2815675.2815692"},{"key":"e_1_2_1_14_2","unstructured":"European Telecommunications Standards Institute. Network Functions Virtualisation \u2013 Introductory White Paper. http:\/\/portal.etsi.org\/NFV\/NFV_White_Paper.pdf 2012.  European Telecommunications Standards Institute. Network Functions Virtualisation \u2013 Introductory White Paper. http:\/\/portal.etsi.org\/NFV\/NFV_White_Paper.pdf 2012."},{"key":"e_1_2_1_15_2","unstructured":"Exablaze. ExaNIC X10. https:\/\/exablaze.com\/exanic-x10. Last accessed: 2017-08-30.  Exablaze. ExaNIC X10. https:\/\/exablaze.com\/exanic-x10. Last accessed: 2017-08-30."},{"key":"e_1_2_1_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/1851182.1851255"},{"key":"e_1_2_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2008.919664"},{"key":"e_1_2_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2015.7045396"},{"key":"e_1_2_1_19_2","volume-title":"September","author":"Intel Corporation","year":"2015","unstructured":"Intel Corporation . Intel 82580EB\/82580 DB Gigabit Ethernet Controller Datasheet . http:\/\/www.intel.com\/content\/www\/us\/en\/embedded\/products\/networking\/82580-eb-db-gbe-controller-datasheet.html. Revision: 2.7 , September 2015 . Intel Corporation. Intel 82580EB\/82580DB Gigabit Ethernet Controller Datasheet. http:\/\/www.intel.com\/content\/www\/us\/en\/embedded\/products\/networking\/82580-eb-db-gbe-controller-datasheet.html. Revision: 2.7, September 2015."},{"key":"e_1_2_1_20_2","unstructured":"Intel Corporation. Intel Ethernet Controller 710 Series Datasheet. http:\/\/www.intel.com\/content\/dam\/www\/public\/us\/en\/documents\/datasheets\/xl710-10-40-controller-datasheet.pdf. Revision: 2.9 April 2017.  Intel Corporation. Intel Ethernet Controller 710 Series Datasheet. http:\/\/www.intel.com\/content\/dam\/www\/public\/us\/en\/documents\/datasheets\/xl710-10-40-controller-datasheet.pdf. Revision: 2.9 April 2017."},{"key":"e_1_2_1_21_2","unstructured":"Ixia. Ixia traffic generator. https:\/\/www.ixiacom.com. Last accessed: 2017-03-01.  Ixia. Ixia traffic generator. https:\/\/www.ixiacom.com. Last accessed: 2017-03-01."},{"key":"e_1_2_1_22_2","first-page":"415","volume-title":"USENIX ATC","author":"Lee C.","year":"2015","unstructured":"C. Lee , C. Park , K. Jang , S. B. Moon , and D. Han . Accurate Latency-based Congestion Feedback for Datacenters . In USENIX ATC , pages 403\u2013 415 , 2015 . C. Lee, C. Park, K. Jang, S. B. Moon, and D. Han. Accurate Latency-based Congestion Feedback for Datacenters. In USENIX ATC, pages 403\u2013415, 2015."},{"key":"e_1_2_1_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/2670979.2670988"},{"key":"e_1_2_1_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/2785956.2787510"},{"key":"e_1_2_1_25_2","first-page":"112","volume-title":"USENIX ATC","author":"Rizzo L.","year":"2012","unstructured":"L. Rizzo . netmap : A Novel Framework for Fast Packet I\/O . In USENIX ATC , pages 101\u2013 112 , 2012 . L. Rizzo. netmap: A Novel Framework for Fast Packet I\/O. In USENIX ATC, pages 101\u2013112, 2012."},{"key":"e_1_2_1_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-28537-0_9"},{"key":"e_1_2_1_27_2","volume-title":"HOTOS-XIII","author":"Rumble S. M.","year":"2011","unstructured":"S. M. Rumble , D. Ongaro , R. Stutsman , M. Rosenblum , and J. K. Ousterhout . It's Time for Low Latency . In HOTOS-XIII , 2011 . S. M. Rumble, D. Ongaro, R. Stutsman, M. Rosenblum, and J. K. Ousterhout. It's Time for Low Latency. In HOTOS-XIII, 2011."},{"key":"e_1_2_1_28_2","unstructured":"Spirent Communications. Spirent test modules and chassis. https:\/\/www.spirent.com\/Products\/TestCenter\/Platforms\/Modules. Last accessed: 2017-03-01.  Spirent Communications. Spirent test modules and chassis. https:\/\/www.spirent.com\/Products\/TestCenter\/Platforms\/Modules. Last accessed: 2017-03-01."},{"key":"e_1_2_1_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2016.03.003"},{"key":"e_1_2_1_30_2","first-page":"468","volume-title":"ISCA","author":"Zhang Y.","year":"2016","unstructured":"Y. Zhang , D. Meisner , J. Mars , and L. Tang . Treadmill: Attributing the Source of Tail Latency through Precise Load Testing and Statistical Inference . In ISCA , pages 456\u2013 468 , 2016 . Y. Zhang, D. Meisner, J. Mars, and L. Tang. Treadmill: Attributing the Source of Tail Latency through Precise Load Testing and Statistical Inference. In ISCA, pages 456\u2013468, 2016."},{"key":"e_1_2_1_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-54328-4_15"}],"container-title":["ACM SIGCOMM Computer Communication Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3155055.3155065","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3155055.3155065","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:26:40Z","timestamp":1750213600000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3155055.3155065"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,25]]},"references-count":31,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2017,10,25]]}},"alternative-id":["10.1145\/3155055.3155065"],"URL":"https:\/\/doi.org\/10.1145\/3155055.3155065","relation":{},"ISSN":["0146-4833"],"issn-type":[{"type":"print","value":"0146-4833"}],"subject":[],"published":{"date-parts":[[2017,10,25]]},"assertion":[{"value":"2017-10-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}