{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T00:52:41Z","timestamp":1760057561700,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,2,10]],"date-time":"2025-02-10T00:00:00Z","timestamp":1739145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"MUR National Recovery and Resilience Plan funded by the European Union\u2014NextGenerationEU","award":["PE00000014"],"award-info":[{"award-number":["PE00000014"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Equipment to be installed in real-time industrial control system networks must be carefully characterized before commissioning to ensure it meets performance requirements. However, performance analysis tools may be expensive and come with stringent hardware and software requirements that render them out of reach for many small and medium enterprises. In this paper, we propose a software tool that leverages inexpensive, commonly available personal computer hardware and Linux-based, user-level open source software to enhance portability, flexibility, and ease of use without sacrificing measurement accuracy. An extensive evaluation of the tool\u2019s custom-designed traffic generator shows that it compares favorably with related work. At the same time, the measurement system is able to achieve remarkable accuracy in determining the mean delay and delay variance of the device under test, as also demonstrated by a practical device evaluation example.<\/jats:p>","DOI":"10.3390\/fi17020078","type":"journal-article","created":{"date-parts":[[2025,2,12]],"date-time":"2025-02-12T11:08:51Z","timestamp":1739358531000},"page":"78","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Low-Cost Software Evaluation of Communication Delays in Networked Industrial Systems"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5716-7870","authenticated-orcid":false,"given":"Manuel","family":"Cheminod","sequence":"first","affiliation":[{"name":"Istituto di Elettronica e di Ingegneria dell\u2019Informazione e delle Telecomunicazioni (IEIIT), Consiglio Nazionale Delle Ricerche (CNR), 10129 Torino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9607-9993","authenticated-orcid":false,"given":"Ivan","family":"Cibrario Bertolotti","sequence":"additional","affiliation":[{"name":"Istituto di Elettronica e di Ingegneria dell\u2019Informazione e delle Telecomunicazioni (IEIIT), Consiglio Nazionale Delle Ricerche (CNR), 10129 Torino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1238-0808","authenticated-orcid":false,"given":"Adriano","family":"Valenzano","sequence":"additional","affiliation":[{"name":"Istituto di Elettronica e di Ingegneria dell\u2019Informazione e delle Telecomunicazioni (IEIIT), Consiglio Nazionale Delle Ricerche (CNR), 10129 Torino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9319-7620","authenticated-orcid":false,"given":"Luca","family":"Durante","sequence":"additional","affiliation":[{"name":"Istituto di Elettronica e di Ingegneria dell\u2019Informazione e delle Telecomunicazioni (IEIIT), Consiglio Nazionale Delle Ricerche (CNR), 10129 Torino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1109\/TII.2012.2198666","article-title":"Review of Security Issues in Industrial Networks","volume":"9","author":"Cheminod","year":"2013","journal-title":"IEEE Trans. Ind. Informat."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2159","DOI":"10.1109\/TII.2018.2802903","article-title":"Performance Evaluation and Modeling of an Industrial Application-Layer Firewall","volume":"14","author":"Cheminod","year":"2018","journal-title":"IEEE Trans. Ind. Informat."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.comcom.2022.04.023","article-title":"Evolution of network time synchronization towards nanoseconds accuracy: A survey","volume":"191","author":"Chefrour","year":"2022","journal-title":"Comput. Commun."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1145\/3503954.3503956","article-title":"When Latency Matters: Measurements and Lessons Learned","volume":"51","author":"Iorio","year":"2021","journal-title":"SIGCOMM Comput. Commun. Rev."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3466167","article-title":"One-Way Delay Measurement From Traditional Networks to SDN: A Survey","volume":"54","author":"Chefrour","year":"2021","journal-title":"ACM Comput. Surv."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3477","DOI":"10.1109\/TNET.2016.2533544","article-title":"Accurate and Efficient Per-Flow Latency Measurement Without Probing and Time Stamping","volume":"24","author":"Shahzad","year":"2016","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2797","DOI":"10.1109\/TNET.2020.3022757","article-title":"Network Latency Estimation With Leverage Sampling for Personal Devices: An Adaptive Tensor Completion Approach","volume":"28","author":"Deng","year":"2020","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_8","unstructured":"(2025, January 28). KIO Networks. How Do you Measure Latency. Available online: https:\/\/kiodatacenters.com\/en\/blog-data-center\/en-us\/blog\/data-center\/how-do-you-measure-latency."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3753","DOI":"10.1109\/TNSM.2021.3081536","article-title":"Measuring Network Conditions in Data Centers Using the Precision Time Protocol","volume":"18","author":"Popescu","year":"2021","journal-title":"IEEE Trans. Netw. Service Manag."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1109\/TIM.2018.2849433","article-title":"An Efficient and Accurate Link Latency Monitoring Method for Low-Latency Software-Defined Networks","volume":"68","author":"Liao","year":"2019","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.comcom.2024.01.010","article-title":"A comprehensive latency profiling study of the Tofino P4 programmable ASIC-based hardware","volume":"218","author":"Franco","year":"2024","journal-title":"Comput. Commun."},{"key":"ref_12","first-page":"58","article-title":"Traffic Generation System for the Defense Advanced Research Projects Agency Spectrum Collaboration Challenge","volume":"35","author":"Curtis","year":"2021","journal-title":"Johns Hopkins Univ. Appl. Phys. Lab. Tech. Dig."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"100555","DOI":"10.1016\/j.segan.2021.100555","article-title":"A methodology for the evaluation of the message transmission delay over IEC 61850 communication network\u2014A real-time HV\/MV substation case study","volume":"28","author":"Feizimirkhani","year":"2021","journal-title":"Sustain. Energy Grids Netw."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1109\/LNET.2022.3203799","article-title":"Experimental Evaluation of End-to-End Delay in a Sigfox Network","volume":"4","author":"Ikonen","year":"2022","journal-title":"IEEE Netw. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5077","DOI":"10.1007\/s11276-022-03212-5","article-title":"Low delay network attributes randomization to proactively mitigate reconnaissance attacks in industrial control systems","volume":"30","author":"Etxezarreta","year":"2024","journal-title":"Wirel. Netw."},{"key":"ref_16","unstructured":"Phanekham, D., and Jones, R. (2025, January 28). What a Trip! Measuring Network Latency in the Cloud. Available online: https:\/\/cloud.google.com\/blog\/products\/networking\/using-netperf-and-ping-to-measure-network-latency."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Van Bemten, A., \u0110eri\u0107, N., Zerwas, J., Blenk, A., Schmid, S., and Kellerer, W. (2019, January 9\u201312). Loko: Predictable Latency in Small Networks. Proceedings of the 15th ACM Int. Conf. on Emerging Networking Experiments And Technologies (CoNEXT), Orlando, FL, USA.","DOI":"10.1145\/3359989.3365424"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3488375","article-title":"Network Traffic Generation: A Survey and Methodology","volume":"55","author":"Adeleke","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"107689","DOI":"10.1016\/j.comnet.2020.107689","article-title":"Formullar: An FPGA-based network testing tool for flexible and precise measurement of ultra-low latency networking systems","volume":"185","author":"Park","year":"2021","journal-title":"Computer Networks"},{"key":"ref_20","unstructured":"Chen, Y., Tian, B., Tian, C., Dai, L., Zhou, Y., Ma, M., Tang, M., Zheng, H., Yang, Z., and Chen, G. (2023, January 17\u201319). Norma: Towards Practical Network Load Testing. Proceedings of the 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23). USENIX Association, Boston, MA, USA. Available online: https:\/\/www.usenix.org\/system\/files\/nsdi23-chen-yanqing.pdf."},{"key":"ref_21","unstructured":"ESnet\/Lawrence Berkeley National Laboratory (2025, January 28). iperf3: A TCP, UDP, and SCTP Network Bandwidth Measurement Tool. Available online: https:\/\/github.com\/esnet\/iperf."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chao, I.C., Lin, S.Y., Lee, K.B., Proctor, F., Shen, C.C., and Chang, F.R. (2014, January 19\u201322). Precise latency measurement of unidirectional-data-flow network equipment. Proceedings of the IEEE Inernational Frequency Control Symp. (FCS), Taipei, Taiwan.","DOI":"10.1109\/FCS.2014.6859840"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Emmerich, P., Gallenm\u00fcller, S., Raumer, D., Wohlfart, F., and Carle, G. (2015, January 28\u201330). MoonGen: A Scriptable High-Speed Packet Generator. Proceedings of the ACM Internet Measurement Conference (IMC), Tokyo, Japan.","DOI":"10.1145\/2815675.2815692"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gallenm\u00fcller, S., Wiedner, F., Naab, J., and Carle, G. (2021, January 25\u201329). Ducked Tails: Trimming the Tail Latency of(f) Packet Processing Systems. Proceedings of the 17th Inernational Conf. on Network and Service Management (CNSM), Izmir, Turkey.","DOI":"10.23919\/CNSM52442.2021.9615532"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1145\/3155055.3155065","article-title":"How to Measure the Killer Microsecond","volume":"47","author":"Primorac","year":"2017","journal-title":"SIGCOMM Comput. Commun. Rev."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1007\/s10922-017-9417-0","article-title":"Throughput and Latency of Virtual Switching with Open vSwitch: A Quantitative Analysis","volume":"26","author":"Emmerich","year":"2018","journal-title":"J. Netw. Syst. Manag."},{"key":"ref_27","unstructured":"Grigorjew, A., Diederich, P., Ho\u00dfffeld, T., and Kellerer, W. (2022, January 11\u201313). Affordable Measurement Setups for Networking Device Latency with Sub-Microsecond Accuracy. Proceedings of the W\u00fcrzburg Workshop on Next-Generation Communication Networks (WueWoWas), W\u00fcrzburg, Germany."},{"key":"ref_28","unstructured":"Intel Corp (2025, January 28). Intel\u00ae Ethernet Controller X550 Datasheet, rev. 2.6. Available online: https:\/\/www.intel.com\/content\/www\/us\/en\/content-details\/333369\/intel-ethernet-controller-x550-datasheet.html."},{"key":"ref_29","unstructured":"(2025, January 28). Startech\u00ae 4-Port Gigabit Ethernet Network Card\u2014PCI Express, Intel\u00ae I350 NIC. Available online: https:\/\/www.startech.com\/en-us\/networking-io\/st4000spexi."},{"key":"ref_30","unstructured":"Intel Corp (2025, January 28). Intel\u00ae Ethernet Controller I350 Datasheet, rev. 2.6. Available online: https:\/\/www.intel.com\/content\/dam\/www\/public\/us\/en\/documents\/datasheets\/ethernet-controller-i350-datasheet.pdf."},{"key":"ref_31","unstructured":"(2008). IEEE Standard for a Precision Clock Synchronization Protocol for Networked Measurement and Control Systems (Standard No. IEEE Std 1588-2008)."},{"key":"ref_32","unstructured":"(2011). IEEE Standard for Local and Metropolitan Area Network\u2014Timing and Synchronization for Time-Sensitive Applications in Bridged Local Area Networks. (Standard No. IEEE Std 802.1AS-2011)."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Cheminod, M., Cibrario Bertolotti, I., Durante, L., Seno, L., and Valenzano, A. (2022, January 17\u201320). Open-source firewalls for industrial applications: A laboratory study of Linux IPFire behavior. Proceedings of the 48th Annual Conf. of the IEEE Industrial Electronics Society (IECON), Brussels, Belgium.","DOI":"10.1109\/IECON49645.2022.9969064"},{"key":"ref_34","unstructured":"Netgear (2025, January 28). Netgear\u00ae 5-Port, 8-Port and 16-Port Gigabit Ethernet Unmanaged Switches. Available online: https:\/\/www.netgear.com\/media\/GS105v5_GS108v4_GS116v2_tcm148-70594.pdf."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/2\/78\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:30:27Z","timestamp":1760027427000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/2\/78"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,10]]},"references-count":34,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["fi17020078"],"URL":"https:\/\/doi.org\/10.3390\/fi17020078","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2025,2,10]]}}}