{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:18:32Z","timestamp":1750220312331,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":18,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,9]],"date-time":"2021-08-09T00:00:00Z","timestamp":1628467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1835608 and 1723717"],"award-info":[{"award-number":["1835608 and 1723717"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,9]]},"DOI":"10.1145\/3474718.3474728","type":"proceedings-article","created":{"date-parts":[[2021,9,7]],"date-time":"2021-09-07T16:42:08Z","timestamp":1631032928000},"page":"72-82","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["User Experiences on Network Testbeds"],"prefix":"10.1145","author":[{"given":"Jelena","family":"Mirkovic","sequence":"first","affiliation":[{"name":"USC Information Sciences Institute, United States of America"}]},{"given":"Portia","family":"Pusey","sequence":"additional","affiliation":[{"name":"Portia Pusey LLC, United States of America"}]}],"member":"320","published-online":{"date-parts":[[2021,9,7]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_3_2_1_1_1","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"doi-asserted-by":"crossref","unstructured":"T. Benzel R. Braden D. Kim C. Neuman A. Joseph K. Sklower R. Ostrenga and S. Schwab. 2006. Experiences With DETER: A Testbed for Security Research. In 2nd IEEE TridentCom.  T. Benzel R. Braden D. Kim C. Neuman A. Joseph K. Sklower R. Ostrenga and S. Schwab. 2006. Experiences With DETER: A Testbed for Security Research. In 2nd IEEE TridentCom.","key":"e_1_3_2_1_2_1","DOI":"10.1109\/TRIDNT.2006.1649172"},{"key":"e_1_3_2_1_3_1","article-title":"Refactoring a full stack web application to remove barriers for student developers and to add customization for instructors","volume":"36","author":"Cook Jack","year":"2020","unstructured":"Jack Cook , Richard Weiss , and Jens Mache . 2020 . Refactoring a full stack web application to remove barriers for student developers and to add customization for instructors . Journal of computing sciences in colleges 36 , 1 (2020). Jack Cook, Richard Weiss, and Jens Mache. 2020. Refactoring a full stack web application to remove barriers for student developers and to add customization for instructors. Journal of computing sciences in colleges 36, 1 (2020).","journal-title":"Journal of computing sciences in colleges"},{"key":"e_1_3_2_1_4_1","first-page":"11","article-title":"Five-point Likert items: t-test versus Mann-Whitney-Wilcoxon","volume":"15","author":"De\u00a0Winter JFC","year":"2010","unstructured":"JFC De\u00a0Winter and Dimitra Dodou . 2010 . Five-point Likert items: t-test versus Mann-Whitney-Wilcoxon . Practical Assessment, Research, and Evaluation 15 , 1(2010), 11 . JFC De\u00a0Winter and Dimitra Dodou. 2010. Five-point Likert items: t-test versus Mann-Whitney-Wilcoxon. Practical Assessment, Research, and Evaluation 15, 1(2010), 11.","journal-title":"Practical Assessment, Research, and Evaluation"},{"key":"e_1_3_2_1_5_1","volume-title":"Applications Grid Workshop, PPAM 2003","author":"Deelman Ewa","year":"2003","unstructured":"Ewa Deelman , James Blythe , Yolanda Gil , Carl Kesselman , Scott Koranda , Albert Lazzarini , Gaurang Mehta , Maria\u00a0Alessandra Papa , and Karan Vahi . 2003 . Pegasus and the Pulsar Search: From Metadata to Execution on the Grid . In Applications Grid Workshop, PPAM 2003 . http:\/\/pegasus.isi.edu\/publications\/ewa\/agw_ppam2003.pdf Ewa Deelman, James Blythe, Yolanda Gil, Carl Kesselman, Scott Koranda, Albert Lazzarini, Gaurang Mehta, Maria\u00a0Alessandra Papa, and Karan Vahi. 2003. Pegasus and the Pulsar Search: From Metadata to Execution on the Grid. In Applications Grid Workshop, PPAM 2003. http:\/\/pegasus.isi.edu\/publications\/ewa\/agw_ppam2003.pdf"},{"unstructured":"DETER. [n.d.]. DeterLab Web page. http:\/\/www.deterlab.net.  DETER. [n.d.]. DeterLab Web page. http:\/\/www.deterlab.net.","key":"e_1_3_2_1_6_1"},{"key":"e_1_3_2_1_7_1","volume-title":"Proceedings of the USENIX Annual Technical Conference (ATC). 1\u201314","author":"Duplyakin Dmitry","year":"2019","unstructured":"Dmitry Duplyakin , Robert Ricci , Aleksander Maricq , Gary Wong , Jonathon Duerig , Eric Eide , Leigh Stoller , Mike Hibler , David Johnson , Kirk Webb , Aditya Akella , Kuangching Wang , Glenn Ricart , Larry Landweber , Chip Elliott , Michael Zink , Emmanuel Cecchet , Snigdhaswin Kar , and Prabodh Mishra . 2019 . The Design and Operation of CloudLab . In Proceedings of the USENIX Annual Technical Conference (ATC). 1\u201314 . https:\/\/www.flux.utah.edu\/paper\/duplyakin-atc19 Dmitry Duplyakin, Robert Ricci, Aleksander Maricq, Gary Wong, Jonathon Duerig, Eric Eide, Leigh Stoller, Mike Hibler, David Johnson, Kirk Webb, Aditya Akella, Kuangching Wang, Glenn Ricart, Larry Landweber, Chip Elliott, Michael Zink, Emmanuel Cecchet, Snigdhaswin Kar, and Prabodh Mishra. 2019. The Design and Operation of CloudLab. In Proceedings of the USENIX Annual Technical Conference (ATC). 1\u201314. https:\/\/www.flux.utah.edu\/paper\/duplyakin-atc19"},{"unstructured":"Rafael Ferreira\u00a0da Silva Henri Casanova Kyle Chard Dan Laney Dong Ahn Shantenu Jha Carole Goble Lavanya Ramakrishnan Luc Peterson Bjoern Enders Douglas Thain Ilkay Altintas Yadu Babuji Rosa Badia Vivien Bonazzi Taina Coleman Michael Crusoe Ewa Deelman Frank Di\u00a0Natale Paolo Di\u00a0Tommaso Thomas Fahringer Rosa Filgueira Grigori Fursin Alex Ganose Bjorn Gruning Daniel\u00a0S. Katz Olga Kuchar Ana Kupresanin Bertram Ludascher Ketan Maheshwari Marta Mattoso Kshitij Mehta Todd Munson Jonathan Ozik Tom Peterka Loic Pottier Tim Randles Stian Soiland-Reyes Benjamin Tovar Matteo Turilli Thomas Uram Karan Vahi Michael Wilde Matthew Wolf and Justin Wozniak. 2021. Workflows Community Summit: Bringing the Scientific Workflows Community Together. https:\/\/doi.org\/10.5281\/zenodo.4606958  Rafael Ferreira\u00a0da Silva Henri Casanova Kyle Chard Dan Laney Dong Ahn Shantenu Jha Carole Goble Lavanya Ramakrishnan Luc Peterson Bjoern Enders Douglas Thain Ilkay Altintas Yadu Babuji Rosa Badia Vivien Bonazzi Taina Coleman Michael Crusoe Ewa Deelman Frank Di\u00a0Natale Paolo Di\u00a0Tommaso Thomas Fahringer Rosa Filgueira Grigori Fursin Alex Ganose Bjorn Gruning Daniel\u00a0S. Katz Olga Kuchar Ana Kupresanin Bertram Ludascher Ketan Maheshwari Marta Mattoso Kshitij Mehta Todd Munson Jonathan Ozik Tom Peterka Loic Pottier Tim Randles Stian Soiland-Reyes Benjamin Tovar Matteo Turilli Thomas Uram Karan Vahi Michael Wilde Matthew Wolf and Justin Wozniak. 2021. Workflows Community Summit: Bringing the Scientific Workflows Community Together. https:\/\/doi.org\/10.5281\/zenodo.4606958","key":"e_1_3_2_1_8_1"},{"unstructured":"Kate Keahey Jason Anderson Zhuo Zhen Pierre Riteau Paul Ruth Dan Stanzione Mert Cevik Jacob Colleran Haryadi\u00a0S Gunawi Cody Hammock 2020. Lessons learned from the Chameleon testbed. In 2020 {USENIX} Annual Technical Conference ({USENIX}{ATC} 20). 219\u2013233.  Kate Keahey Jason Anderson Zhuo Zhen Pierre Riteau Paul Ruth Dan Stanzione Mert Cevik Jacob Colleran Haryadi\u00a0S Gunawi Cody Hammock 2020. Lessons learned from the Chameleon testbed. In 2020 {USENIX} Annual Technical Conference ({USENIX}{ATC} 20). 219\u2013233.","key":"e_1_3_2_1_9_1"},{"key":"e_1_3_2_1_10_1","first-page":"12","article-title":"Testbeds for ubiquitous robotics: A survey","volume":"61","author":"Manzoor Sarah","year":"2013","unstructured":"Sarah Manzoor , Raza\u00a0Ul Islam , Aayman Khalid , Abdul Samad , and Jamshed Iqbal . 2013 . Testbeds for ubiquitous robotics: A survey . Robotics and Autonomous Systems 61 (2013), 12 . Sarah Manzoor, Raza\u00a0Ul Islam, Aayman Khalid, Abdul Samad, and Jamshed Iqbal. 2013. Testbeds for ubiquitous robotics: A survey. Robotics and Autonomous Systems 61 (2013), 12.","journal-title":"Robotics and Autonomous Systems"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_11_1","DOI":"10.1145\/3328778.3366935"},{"key":"e_1_3_2_1_12_1","volume-title":"\u00a0H. Peterson","author":"Mirkovic Jelena","year":"2014","unstructured":"Jelena Mirkovic and Peter A . \u00a0H. Peterson . 2014 . Class Capture-the-Flag Exercises. In 2014 USENIX Summit on Gaming, Games, and Gamification in Security Education (3GSE 14). USENIX Association , San Diego, CA. https:\/\/www.usenix.org\/conference\/3gse14\/summit-program\/presentation\/mirkovic Jelena Mirkovic and Peter A.\u00a0H. Peterson. 2014. Class Capture-the-Flag Exercises. In 2014 USENIX Summit on Gaming, Games, and Gamification in Security Education (3GSE 14). USENIX Association, San Diego, CA. https:\/\/www.usenix.org\/conference\/3gse14\/summit-program\/presentation\/mirkovic"},{"key":"e_1_3_2_1_13_1","volume-title":"Teaching Security with Network Testbeds. In ACM Sigcomm Educational Workshop.","author":"Mirkovic Jelena","year":"2011","unstructured":"Jelena Mirkovic , Mike Ryan , John Hickey , Keith Sklower , Peter Reiher , Peter A.\u00a0H. Peterson , B.\u00a0 Hoon Kang , Mooi\u00a0Choo Chuah , Daniel Massey , and Gisele Ragusa . 2011 . Teaching Security with Network Testbeds. In ACM Sigcomm Educational Workshop. Jelena Mirkovic, Mike Ryan, John Hickey, Keith Sklower, Peter Reiher, Peter A.\u00a0H. Peterson, B.\u00a0Hoon Kang, Mooi\u00a0Choo Chuah, Daniel Massey, and Gisele Ragusa. 2011. Teaching Security with Network Testbeds. In ACM Sigcomm Educational Workshop."},{"key":"e_1_3_2_1_14_1","volume-title":"Engaging Novices in Cybersecurity Competitions: A Vision and Lessons Learned at ACM Tapia","author":"Mirkovic Jelena","year":"2015","unstructured":"Jelena Mirkovic , Aimee Tabor , Simon Woo , and Portia Pusey . 2015. Engaging Novices in Cybersecurity Competitions: A Vision and Lessons Learned at ACM Tapia 2015 . In 2015 USENIX Summit on Gaming, Games, and Gamification in Security Education (3GSE 15). USENIX Association , Washington, D.C.https:\/\/www.usenix.org\/conference\/3gse15\/summit-program\/presentation\/mirkovic Jelena Mirkovic, Aimee Tabor, Simon Woo, and Portia Pusey. 2015. Engaging Novices in Cybersecurity Competitions: A Vision and Lessons Learned at ACM Tapia 2015. In 2015 USENIX Summit on Gaming, Games, and Gamification in Security Education (3GSE 15). USENIX Association, Washington, D.C.https:\/\/www.usenix.org\/conference\/3gse15\/summit-program\/presentation\/mirkovic"},{"unstructured":"COSMOS Project. [n.d.]. COSMOS Education Toolkit. https:\/\/www.cosmos-lab.org\/cosmos-toolkit\/.  COSMOS Project. [n.d.]. COSMOS Education Toolkit. https:\/\/www.cosmos-lab.org\/cosmos-toolkit\/.","key":"e_1_3_2_1_15_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_16_1","DOI":"10.1145\/3372224.3380891"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_17_1","DOI":"10.1109\/MCSE.2014.80"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_18_1","DOI":"10.1145\/3408877.3439530"}],"event":{"acronym":"CSET '21","name":"CSET '21: Cyber Security Experimentation and Test Workshop","location":"Virtual CA USA"},"container-title":["Cyber Security Experimentation and Test Workshop"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474718.3474728","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3474718.3474728","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3474718.3474728","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:11:46Z","timestamp":1750191106000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474718.3474728"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,9]]},"references-count":18,"alternative-id":["10.1145\/3474718.3474728","10.1145\/3474718"],"URL":"https:\/\/doi.org\/10.1145\/3474718.3474728","relation":{},"subject":[],"published":{"date-parts":[[2021,8,9]]},"assertion":[{"value":"2021-09-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}