{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:15:05Z","timestamp":1750220105007,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":31,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,8,8]],"date-time":"2022-08-08T00:00:00Z","timestamp":1659916800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,8,8]]},"DOI":"10.1145\/3546096.3546115","type":"proceedings-article","created":{"date-parts":[[2022,8,4]],"date-time":"2022-08-04T16:05:58Z","timestamp":1659629158000},"page":"71-80","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Verification of Cyber Emulation Experiments Through Virtual Machine and Host Metrics"],"prefix":"10.1145","author":[{"given":"Jamie","family":"Thorpe","sequence":"first","affiliation":[{"name":"Sandia National Laboratories, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Laura P.","family":"Swiler","sequence":"additional","affiliation":[{"name":"Sandia National Laboratories, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Seth","family":"Hanson","sequence":"additional","affiliation":[{"name":"Sandia National Laboratories, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gerardo","family":"Cruz","sequence":"additional","affiliation":[{"name":"Sandia National Laboratories, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Tarman","sequence":"additional","affiliation":[{"name":"Sandia National Laboratories, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Trevor","family":"Rollins","sequence":"additional","affiliation":[{"name":"Sandia National Laboratories, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bert J.","family":"Debusschere","sequence":"additional","affiliation":[{"name":"Sandia National Laboratories, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,8,8]]},"reference":[{"volume-title":"IEEE Standard for System and Software Verification and Validation","year":"2012","key":"e_1_3_2_1_1_1","unstructured":"2012. IEEE Standard for System and Software Verification and Validation . IEEE Std 1012- 2012 (Revision of IEEE Std 1012-2004) (2012), 1\u2013223. https:\/\/doi.org\/10.1109\/IEEESTD.2012.6204026 10.1109\/IEEESTD.2012.6204026 2012. IEEE Standard for System and Software Verification and Validation. IEEE Std 1012-2012 (Revision of IEEE Std 1012-2004) (2012), 1\u2013223. https:\/\/doi.org\/10.1109\/IEEESTD.2012.6204026"},{"key":"e_1_3_2_1_2_1","unstructured":"2018. Alert (TA18-201A) Emotet Malware. Techncial Report. US CERT. https:\/\/us-cert.cisa.gov\/ncas\/alerts\/TA18-201A  2018. Alert (TA18-201A) Emotet Malware. Techncial Report. US CERT. https:\/\/us-cert.cisa.gov\/ncas\/alerts\/TA18-201A"},{"key":"e_1_3_2_1_3_1","volume-title":"https:\/\/docs.microsoft.com\/en-us\/azure\/azure-monitor\/autoscale\/autoscale-common-metrics","author":"Monitor Azure","year":"2021","unstructured":"2021. Azure Monitor . ( 2021 ). https:\/\/docs.microsoft.com\/en-us\/azure\/azure-monitor\/autoscale\/autoscale-common-metrics . 2021. Azure Monitor. (2021). https:\/\/docs.microsoft.com\/en-us\/azure\/azure-monitor\/autoscale\/autoscale-common-metrics."},{"key":"e_1_3_2_1_4_1","unstructured":"2021. Cloud Telemetry: Advancing Your IT Strategy. (2021). https:\/\/www.intel.com\/content\/www\/us\/en\/cloud-computing\/telemetry.html.  2021. Cloud Telemetry: Advancing Your IT Strategy. (2021). https:\/\/www.intel.com\/content\/www\/us\/en\/cloud-computing\/telemetry.html."},{"key":"e_1_3_2_1_5_1","unstructured":"2021. Network Telemetry. (2021). https:\/\/cloud.google.com\/network-telemetry.  2021. Network Telemetry. (2021). https:\/\/cloud.google.com\/network-telemetry."},{"key":"e_1_3_2_1_6_1","unstructured":"2021. What is Telemetry? The Guide to Application Monitoring. (2021). https:\/\/www.sumologic.com\/insight\/what-is-telemetry\/.  2021. What is Telemetry? The Guide to Application Monitoring. (2021). https:\/\/www.sumologic.com\/insight\/what-is-telemetry\/."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CATCH.2009.30"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/MILCOM.2015.7357619"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2014.02.022"},{"key":"e_1_3_2_1_10_1","unstructured":"Cisco. 2019. Snort intrusion detection and prevention system. https:\/\/www.snort.org\/.  Cisco. 2019. Snort intrusion detection and prevention system. https:\/\/www.snort.org\/."},{"key":"e_1_3_2_1_11_1","volume-title":"Virtually the Same: Comparing Physical and Virtual Testbeds. In 2019 International Conference on Computing, Networking and Communications (ICNC). IEEE.","author":"Crussell Jonathan","year":"2019","unstructured":"Jonathan Crussell , Thomas\u00a0 M Kroeger , Aaron Brown , and Cynthia Phillips . 2019 . Virtually the Same: Comparing Physical and Virtual Testbeds. In 2019 International Conference on Computing, Networking and Communications (ICNC). IEEE. Jonathan Crussell, Thomas\u00a0M Kroeger, Aaron Brown, and Cynthia Phillips. 2019. Virtually the Same: Comparing Physical and Virtual Testbeds. In 2019 International Conference on Computing, Networking and Communications (ICNC). IEEE."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MILCOM.2014.27"},{"key":"e_1_3_2_1_15_1","unstructured":"Brandon\u00a0David Heller. 2013. Reproducible Network Research with High-Fidelity Emulation. (2013).  Brandon\u00a0David Heller. 2013. Reproducible Network Research with High-Fidelity Emulation. (2013)."},{"key":"e_1_3_2_1_16_1","volume-title":"Large-scale Virtualization in the Emulab Network Testbed. In 2008 USENIX Annual Technical Conference (USENIX ATC 08)","author":"Hibler Mike","year":"2008","unstructured":"Mike Hibler , Robert Ricci , Leigh Stoller , Jonathon Duerig , Shashi Guruprasad , Tim Stack , Kirk Webb , and Jay Lepreau . 2008 . Large-scale Virtualization in the Emulab Network Testbed. In 2008 USENIX Annual Technical Conference (USENIX ATC 08) . USENIX Association. Mike Hibler, Robert Ricci, Leigh Stoller, Jonathon Duerig, Shashi Guruprasad, Tim Stack, Kirk Webb, and Jay Lepreau. 2008. Large-scale Virtualization in the Emulab Network Testbed. In 2008 USENIX Annual Technical Conference (USENIX ATC 08). USENIX Association."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/EuroSPW51379.2020.00015"},{"key":"e_1_3_2_1_18_1","unstructured":"Quan Jia Zhaohui Wang and Angelos Stavrou. 2009. The Heisenberg Measuring Uncertainty in Lightweight Virtualization Testbeds.. In CSET.  Quan Jia Zhaohui Wang and Angelos Stavrou. 2009. The Heisenberg Measuring Uncertainty in Lightweight Virtualization Testbeds.. In CSET."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11036-019-01426-0"},{"key":"e_1_3_2_1_20_1","volume-title":"Taming Performance Variability. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201918)","author":"Maricq Aleksander","year":"2018","unstructured":"Aleksander Maricq , Dmitry Duplyakin , Ivo Jimenez , Carlos Maltzahn , Ryan Stutsman , and Robert Ricci . 2018 . Taming Performance Variability. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201918) . USENIX Association. Aleksander Maricq, Dmitry Duplyakin, Ivo Jimenez, Carlos Maltzahn, Ryan Stutsman, and Robert Ricci. 2018. Taming Performance Variability. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201918). USENIX Association."},{"key":"#cr-split#-e_1_3_2_1_21_1.1","doi-asserted-by":"crossref","unstructured":"Stephen Midway Matthew Robertson Shane Flinn and Michael Kaller. 2020. Comparing multiple comparisons: practical guidance for choosing the best multiple comparisons test. PeerJ 8(2020). https:\/\/doi.org\/10.7717\/peerj.10387 10.7717\/peerj.10387","DOI":"10.7717\/peerj.10387"},{"key":"#cr-split#-e_1_3_2_1_21_1.2","doi-asserted-by":"crossref","unstructured":"Stephen Midway Matthew Robertson Shane Flinn and Michael Kaller. 2020. Comparing multiple comparisons: practical guidance for choosing the best multiple comparisons test. PeerJ 8(2020). https:\/\/doi.org\/10.7717\/peerj.10387","DOI":"10.7717\/peerj.10387"},{"key":"e_1_3_2_1_22_1","unstructured":"minimega developers. 2019. minimega: a distributed VM management tool. http:\/\/minimega.org\/  minimega developers. 2019. minimega: a distributed VM management tool. http:\/\/minimega.org\/"},{"key":"e_1_3_2_1_23_1","volume-title":"DEW: Distributed Experiment Workflows. In 11th USENIX Workshop on Cyber Security Experimentation and Test CSET 18)","author":"Mirkovic Jelena","year":"2018","unstructured":"Jelena Mirkovic , Genevieve Bartlett , and Jim Blythe . 2018 . DEW: Distributed Experiment Workflows. In 11th USENIX Workshop on Cyber Security Experimentation and Test CSET 18) . Jelena Mirkovic, Genevieve Bartlett, and Jim Blythe. 2018. DEW: Distributed Experiment Workflows. In 11th USENIX Workshop on Cyber Security Experimentation and Test CSET 18)."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/THS.2010.5655108"},{"volume-title":"Verification and validation in scientific computing","author":"Oberkampf L","key":"e_1_3_2_1_25_1","unstructured":"William\u00a0 L Oberkampf and Christopher\u00a0 J Roy . 2010. Verification and validation in scientific computing . Cambridge University Press . William\u00a0L Oberkampf and Christopher\u00a0J Roy. 2010. Verification and validation in scientific computing. Cambridge University Press."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/AERO.2002.1036158"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/EuroSPW.2019.00017"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/SURV.2012.0601112.00185"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3474718.3474725"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3384217.3385626"},{"key":"e_1_3_2_1_31_1","volume-title":"Detection of command and control traffic: model development and experimental validation. in preparation","author":"Vugrin Eric","year":"2021","unstructured":"Eric Vugrin , Seth Hanson , Jerry Cruz , Casey Glatter , Thomas Tarman , and Ali Pinar . 2021. Detection of command and control traffic: model development and experimental validation. in preparation ( 2021 ). Eric Vugrin, Seth Hanson, Jerry Cruz, Casey Glatter, Thomas Tarman, and Ali Pinar. 2021. Detection of command and control traffic: model development and experimental validation. in preparation (2021)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEsCPS.2015.11"}],"event":{"name":"CSET 2022: Cyber Security Experimentation and Test Workshop","acronym":"CSET 2022","location":"Virtual CA USA"},"container-title":["Proceedings of the 15th Workshop on Cyber Security Experimentation and Test"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3546096.3546115","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3546096.3546115","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:10:28Z","timestamp":1750183828000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3546096.3546115"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,8]]},"references-count":31,"alternative-id":["10.1145\/3546096.3546115","10.1145\/3546096"],"URL":"https:\/\/doi.org\/10.1145\/3546096.3546115","relation":{},"subject":[],"published":{"date-parts":[[2022,8,8]]},"assertion":[{"value":"2022-08-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}