{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T10:14:18Z","timestamp":1779099258214,"version":"3.51.4"},"reference-count":127,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2020,12,13]],"date-time":"2020-12-13T00:00:00Z","timestamp":1607817600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Cyber situational awareness has been proven to be of value in forming a comprehensive understanding of threats and vulnerabilities within organisations, as the degree of exposure is governed by the prevailing levels of cyber-hygiene and established processes. A more accurate assessment of the security provision informs on the most vulnerable environments that necessitate more diligent management. The rapid proliferation in the automation of cyber-attacks is reducing the gap between information and operational technologies and the need to review the current levels of robustness against new sophisticated cyber-attacks, trends, technologies and mitigation countermeasures has become pressing. A deeper characterisation is also the basis with which to predict future vulnerabilities in turn guiding the most appropriate deployment technologies. Thus, refreshing established practices and the scope of the training to support the decision making of users and operators. The foundation of the training provision is the use of Cyber-Ranges (CRs) and Test-Beds (TBs), platforms\/tools that help inculcate a deeper understanding of the evolution of an attack and the methodology to deploy the most impactful countermeasures to arrest breaches. In this paper, an evaluation of documented CRs and TBs platforms is evaluated. CRs and TBs are segmented by type, technology, threat scenarios, applications and the scope of attainable training. To enrich the analysis of documented CRs and TBs research and cap the study, a taxonomy is developed to provide a broader comprehension of the future of CRs and TBs. The taxonomy elaborates on the CRs\/TBs dimensions, as well as, highlighting a diminishing differentiation between application areas.<\/jats:p>","DOI":"10.3390\/s20247148","type":"journal-article","created":{"date-parts":[[2020,12,13]],"date-time":"2020-12-13T23:39:36Z","timestamp":1607902776000},"page":"7148","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":107,"title":["A Review of Cyber-Ranges and Test-Beds: Current and Future Trends"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1350-4438","authenticated-orcid":false,"given":"Elochukwu","family":"Ukwandu","sequence":"first","affiliation":[{"name":"Department of Computer Science, Cardiff School of Technologies, Cardiff Metropolitan University, Cardiff CF5 2YB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0135-9942","authenticated-orcid":false,"given":"Mohamed Amine Ben","family":"Farah","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XQ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5195-8193","authenticated-orcid":false,"given":"Hanan","family":"Hindy","sequence":"additional","affiliation":[{"name":"Division of Cybersecurity, Abertay University, Dundee DD1 1HG, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9677-1445","authenticated-orcid":false,"given":"David","family":"Brosset","sequence":"additional","affiliation":[{"name":"Naval Academy Research Institute, Arts et M\u00e9tiers Institute of Technology, Rue du Poulmic, 29160 Lanv\u00e9oc, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2677-6347","authenticated-orcid":false,"given":"Dimitris","family":"Kavallieros","sequence":"additional","affiliation":[{"name":"The Center for Security Studies (KEMEA), GR-101 77 Athens, Greece"},{"name":"Department of Informatics and Telecommunications, University of Peloponnese, 221 00 Tripoli, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6206-2229","authenticated-orcid":false,"given":"Robert","family":"Atkinson","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XQ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9150-6805","authenticated-orcid":false,"given":"Christos","family":"Tachtatzis","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XQ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2994-7826","authenticated-orcid":false,"given":"Miroslav","family":"Bures","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Faculty of Electrical Engineering, Czech Technical University in Prague, 166 36 Prague 6, Czech Republic"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9093-5245","authenticated-orcid":false,"given":"Ivan","family":"Andonovic","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XQ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1849-5788","authenticated-orcid":false,"given":"Xavier","family":"Bellekens","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XQ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"672","DOI":"10.3390\/fi4030672","article-title":"Stuxnet: What has changed?","volume":"4","author":"Denning","year":"2012","journal-title":"Future Internet"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lallie, H.S., Shepherd, L.A., Nurse, J.R.C., Erola, A., Epiphaniou, G., Maple, C., and Bellekens, X. (2020). Cyber Security in the Age of COVID-19: A Timeline and Analysis of Cyber-Crime and Cyber-Attacks during the Pandemic. arXiv.","DOI":"10.1016\/j.cose.2021.102248"},{"key":"ref_3","unstructured":"Leyden, J. (2010). Stuxnet\u2019a Game Changer for Malware Defence\u2019, The Register."},{"key":"ref_4","first-page":"1","article-title":"After Stuxnet: The new rules of cyberwar","volume":"5","author":"Mitchell","year":"2012","journal-title":"Computerworld"},{"key":"ref_5","unstructured":"Benson, P. (2020, December 11). Computer Virus Stuxnet a \u2018Game Changer\u2019, DHS Official Tells Senate. Available online: http:\/\/edition.cnn.com\/2010\/TECH\/web\/11\/17\/stuxnet.virus\/index.html."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Aldawood, H., and Skinner, G. (2018, January 4\u20137). Educating and raising awareness on cyber security social engineering: A literature review. Proceedings of the 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE), Wollongong, NSW, Australia.","DOI":"10.1109\/TALE.2018.8615162"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zwilling, M., Klien, G., Lesjak, D., Wiechetek, \u0141., Cetin, F., and Basim, H.N. (2020). Cyber Security Awareness, Knowledge and Behavior: A Comparative Study. J. Comput. Inf. Syst., 1\u201316.","DOI":"10.1080\/08874417.2020.1712269"},{"key":"ref_8","first-page":"181","article-title":"National initiative for cybersecurity education (NICE) cybersecurity workforce framework","volume":"800","author":"Newhouse","year":"2017","journal-title":"NIST Spec. Publ."},{"key":"ref_9","unstructured":"Giuliano, V., and Formicola, V. (2019). ICSrange: A Simulation-based Cyber Range Platform for Industrial Control Systems. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Yonemura, K., Sato, J., Komura, R., and Matsuoka, M. (2018, January 17\u201320). Practical security education on combination of OT and ICT using gamfication method. Proceedings of the 2018 IEEE Global Engineering Education Conference (EDUCON 2018), Tenerife, Spain.","DOI":"10.1109\/EDUCON.2018.8363305"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Van der Velde, D., Henze, M., Kathmann, P., Wassermann, E., Andres, M., Bracht, D., Ernst, R., Hallak, G., Klaer, B., and Linnartz, P. (2020). Methods for Actors in the Electric Power System to Prevent, Detect and React to ICT Attacks and Failures. arXiv.","DOI":"10.1109\/ENERGYCon48941.2020.9236523"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Vozikis, D., Darra, E., Kuusk, T., Kavallieros, D., Reintam, A., and Bellekens, X. (2020, January 25\u201328). On the Importance of Cyber-Security Training for Multi-Vector Energy Distribution System Operators. Proceedings of the 15th International Conference on Availability, Reliability and Security, online, online.","DOI":"10.1145\/3407023.3409313"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Okoli, C., and Schabram, K. (2010). A Guide to Conducting a Systematic Literature Review of Information Systems Research. SSRN Electron. J.","DOI":"10.2139\/ssrn.1954824"},{"key":"ref_14","first-page":"43","article-title":"A Guide to Conducting a Standalone Systematic Literature Review","volume":"37","author":"Okoli","year":"2015","journal-title":"Commun. Assoc. Inf. Syst."},{"key":"ref_15","unstructured":"de Boer, F., and Cerone, A. (2020). Interoperability and Integration Testing Methods for IoT Systems: A Systematic Mapping Study. Software Engineering and Formal Methods, Springer International Publishing."},{"key":"ref_16","unstructured":"Davis, J., and Magrath, S. (2020, December 11). A Survey of Cyber Ranges and Testbeds. Available online: https:\/\/apps.dtic.mil\/dtic\/tr\/fulltext\/u2\/a594524.pdf."},{"key":"ref_17","unstructured":"Ranka, J. (2020, December 11). National Cyber Range. Available online: https:\/\/apps.dtic.mil\/dtic\/tr\/fulltext\/u2\/a551864.pdf."},{"key":"ref_18","unstructured":"Leblanc, S.P., Partington, A., Chapman, I.M., and Bernier, M. (2011, January 3\u20137). An Overview of Cyber Attack and Computer Network Operations Simulation. Proceedings of the 2011 Military Modeling & Simulation Symposium, Boston, MA, USA."},{"key":"ref_19","unstructured":"Priyadarshini, I. (2018). Features and Architecture of the Modern Cyber Range: A Qualitative Analysis and Survey. [Ph.D. Thesis, University of Delaware]."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"101636","DOI":"10.1016\/j.cose.2019.101636","article-title":"Cyber Ranges and Security Testbeds: Scenarios, Functions, Tools and Architecture","volume":"88","author":"Yamin","year":"2020","journal-title":"Comput. Secur."},{"key":"ref_21","first-page":"46","article-title":"Virginia cyber range","volume":"19","author":"Radziwill","year":"2017","journal-title":"Softw. Qual. Prof."},{"key":"ref_22","unstructured":"Sommestad, T. (2020, December 11). Experimentation on Operational Cyber Security in CRATE. Available online: http:\/\/www.sommestad.com\/teodor\/Filer\/Sommestad%20-%202015%20-%20Experimentation%20on%20operational%20cyber%20security%20in%20CRATE.pdf."},{"key":"ref_23","unstructured":"Pernik, P. (2020, December 11). Improving Cyber Security: NATO and the EU. Available online: https:\/\/icds.ee\/wp-content\/uploads\/2010\/02\/Piret_Pernik_-_Improving_Cyber_Security.pdf."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ferguson, B., Tall, A., and Olsen, D. (2014, January 6\u20138). National cyber range overview. Proceedings of the 2014 IEEE Military Communications Conference, Baltimore, MD, USA.","DOI":"10.1109\/MILCOM.2014.27"},{"key":"ref_25","unstructured":"Mudge, R.S., and Lingley, S. (2020, December 11). Cyber and Air Joint Effects Demonstration (CAAJED). Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.460.476&rep=rep1&type=pdf."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Meitzler, W.D., Ouderkirk, S.J., and Hughes, C.O. (2009). Security Assessment Simulation Toolkit (SAST) Final Report, Technical report.","DOI":"10.2172\/1023739"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Varshney, M., Pickett, K., and Bagrodia, R. (2011, January 7\u201310). A live-virtual-constructive (LVC) framework for cyber operations test, evaluation and training. Proceedings of the 2011-MILCOM 2011 Military Communications Conference, Baltimore, MD, USA.","DOI":"10.1109\/MILCOM.2011.6127499"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chi, S.D., Park, J.S., and Lee, J.S. (2003). A role of DEVS simulation for information assurance. International Workshop on Information Security Applications, Springer.","DOI":"10.1007\/978-3-540-24591-9_3"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Liljenstam, M., Liu, J., Nicol, D., Yuan, Y., Yan, G., and Grier, C. (2005, January 1\u20133). Rinse: The real-time immersive network simulation environment for network security exercises. Proceedings of the Workshop on Principles of Advanced and Distributed Simulation (PADS\u201905), Monterey, CA, USA.","DOI":"10.1177\/0037549706065544"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Brown, B., Cutts, A., McGrath, D., Nicol, D.M., Smith, T.P., and Tofel, B. (2003, January 21\u201325). Simulation of cyber attacks with applications in homeland defense training. Proceedings of the Sensors, and Command, Control, Communications, and Intelligence (C3I) Technologies for Homeland Defense and Law Enforcement II, Orlando, FL, USA.","DOI":"10.1117\/12.500847"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kuhl, M.E., Sudit, M., Kistner, J., and Costantini, K. (2007, January 9\u201312). Cyber attack modeling and simulation for network security analysis. Proceedings of the 2007 Winter Simulation Conference, Washington, DC, USA.","DOI":"10.1109\/WSC.2007.4419720"},{"key":"ref_32","unstructured":"Zhou, M., and Lang, S.D. (2020, December 11). A Frequency-Based Approach to Intrusion Detection. Available online: https:\/\/d1wqtxts1xzle7.cloudfront.net\/56628641\/dosdos.pdf?1527000071=&response-content-disposition=inline%3B+filename%3DA_Frequency_Based_Approach_to_Intrusion.pdf&Expires=1607693224&Signature=BsARTy9SFcwtnh3em1-GAbLEdtohfiBZqLiuH5ODCyL5hife4Ga95~urso2IqlZxQnaAN~GepEHt8ovbOD9-XdAXMfLvKQ6PCBdFX5fhWYE2ZOGWfgcBjEy16pMT9egqXlZkSr4e-raPjDQy6GxeQRTTe4Z~tlQTCtdI6dn6GOGQssPh3lv5bwwbi6CnPBScFCv823Gwfbkk2rPp5WyLGRMKFaXlqRdzmFrqYKdUpsTeRK-bNXBjViTrD6hlbA0iFl3ELVh431TX1OC1elbrdZWaQL8sZPmi6YmM5XNH2SJ5RyqawQ1HrHjA9-Jhs3kMs5rqRw9l857KsGg9G4Whwg__&Key-Pair-Id=APKAJLOHF5GGSLRBV4ZA."},{"key":"ref_33","unstructured":"Rossey, L.M., Cunningham, R.K., Fried, D.J., Rabek, J.C., Lippmann, R.P., Haines, J.W., and Zissman, M.A. (2002, January 9\u201316). LARIAT: Lincoln adaptable real-time information assurance testbed. Proceedings of the IEEE Aerospace Conference, Big Sky, MT, USA."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Pederson, P., Lee, D., Shu, G., Chen, D., Liu, Z., Li, N., and Sang, L. (2008, January 12\u201313). Virtual Cyber-Security Testing Capability for Large Scale Distributed Information Infrastructure Protection. Proceedings of the 2008 IEEE Conference on Technologies for Homeland Security, Waltham, MA, USA.","DOI":"10.1109\/THS.2008.4534480"},{"key":"ref_35","unstructured":"Anderson, R.S. (2009). Cyber Security and Resilient Systems, Technical report."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1109\/SURV.2012.0601112.00185","article-title":"On the use of Emulab testbeds for scientifically rigorous experiments","volume":"15","author":"Siaterlis","year":"2012","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_37","unstructured":"Mayo, J., Minnich, R., Rudish, D., and Armstrong, R. (2020, December 11). Approaches for Scalable Modeling and Emulation of Cyber Systems: LDRD Final Report. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.463.1793&rep=rep1&type=pdf."},{"key":"ref_38","unstructured":"Thomas, J., Meunier, P., Eugster, P., and Vitek, J. (2009, January 9\u201310). Mandatory access control for experiments with malware. Proceedings of the 10th Annual Information Security Symposium, West Lafayette, IN, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"S105","DOI":"10.1016\/j.diin.2008.05.009","article-title":"Automated computer forensics training in a virtualized environment","volume":"5","author":"Brueckner","year":"2008","journal-title":"Digit. Investig."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"e3446","DOI":"10.1002\/dac.3446","article-title":"Testbed@ TWISC: A network security experiment platform","volume":"31","author":"Tsai","year":"2018","journal-title":"Int. J. Commun. Syst."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Herold, N., Wachs, M., Dorfhuber, M., Rudolf, C., Liebald, S., and Carle, G. (2017). Achieving reproducible network environments with INSALATA. IFIP International Conference on Autonomous Infrastructure, Management and Security, Springer.","DOI":"10.1007\/978-3-319-60774-0_3"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Chadha, R., Bowen, T., Chiang, C.Y.J., Gottlieb, Y.M., Poylisher, A., Sapello, A., Serban, C., Sugrim, S., Walther, G., and Marvel, L.M. (2016, January 1\u20133). Cybervan: A cyber security virtual assured network testbed. Proceedings of the MILCOM 2016\u20142016 IEEE Military Communications Conference, Baltimore, MD, USA.","DOI":"10.1109\/MILCOM.2016.7795481"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Gunathilaka, P., Mashima, D., and Chen, B. (2016, January 28). Softgrid: A software-based smart grid testbed for evaluating substation cybersecurity solutions. Proceedings of the 2nd ACM Workshop on Cyber-Physical Systems Security and Privacy, Vienna, Austria.","DOI":"10.1145\/2994487.2994494"},{"key":"ref_44","unstructured":"Haines, J.W., Rossey, L.M., Lippmann, R.P., and Cunningham, R.K. (2001, January 12\u201316). Extending the darpa off-line intrusion detection evaluations. Proceedings of the DARPA Information Survivability Conference and Exposition II. DISCEX\u201901, Anaheim, CA, USA."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Hahn, A., Kregel, B., Govindarasu, M., Fitzpatrick, J., Adnan, R., Sridhar, S., and Higdon, M. (2010, January 21\u201323). Development of the PowerCyber SCADA security testbed. Proceedings of the Sixth Annual Workshop on Cyber Security and Information Intelligence Research, Oak Ridge, TN, USA.","DOI":"10.1145\/1852666.1852690"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Katsikas, S.K., Cuppens, F., Cuppens, N., Lambrinoudakis, C., Ant\u00f3n, A., Gritzalis, S., Mylopoulos, J., and Kalloniatis, C. (2019). Improving SIEM for Critical SCADA Water Infrastructures Using Machine Learning. Computer Security, Springer International Publishing.","DOI":"10.1007\/978-3-030-12786-2"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Tam, K., and Jones, K. (2020, December 11). Cyber-SHIP: Developing Next Generation Maritime Cyber Research Capabilities. Available online: https:\/\/pearl.plymouth.ac.uk\/handle\/10026.1\/14949.","DOI":"10.24868\/icmet.oman.2019.005"},{"key":"ref_48","unstructured":"Hildebrand, E., Flinterman, R., Mulder, J., and Smit, A. (2020, December 11). Clusus: A Cyber Range for Network Attack Simulations. Available online: http:\/\/resolver.tudelft.nl\/uuid:2588ee53-0249-476f-aa53-54d7a368dc8e."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Hallaq, B., Nicholson, A., Smith, R., Maglaras, L., Janicke, H., and Jones, K. (2018). CYRAN: A hybrid cyber range for testing security on ICS\/SCADA systems. Cyber Security and Threats: Concepts, Methodologies, Tools, and Applications, IGI Global.","DOI":"10.4018\/978-1-5225-5634-3.ch033"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Ghaleb, A., Zhioua, S., and Almulhem, A. (2016, January 12\u201314). SCADA-SST: A SCADA security testbed. Proceedings of the 2016 World Congress on Industrial Control Systems Security (WCICSS), London, UK.","DOI":"10.1109\/WCICSS.2016.7882610"},{"key":"ref_51","unstructured":"\u010celeda, P., \u010cegan, J., Vykopal, J., and Tovar\u0148\u00e1k, D. (2020, December 11). Kypo\u2014A platform for cyber defence exercises. Available online: https:\/\/is.muni.cz\/repo\/1319597\/2015-NATO-MSG-133-kypo-platform-cyber-defence-exercises-paper.pdf."},{"key":"ref_52","unstructured":"Vykopal, J., O\u0161lej\u0161ek, R., \u010celeda, P., Vizvary, M., and Tovar\u0148\u00e1k, D. (2020, December 11). Kypo Cyber Range: Design and Use Cases. Available online: https:\/\/repozitar.cz\/repo\/26486\/."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Almalawi, A., Tari, Z., Khalil, I., and Fahad, A. (2013, January 21\u201324). SCADAVT-A framework for SCADA security testbed based on virtualization technology. Proceedings of the 38th Annual IEEE Conference on Local Computer Networks, Sydney, Australia.","DOI":"10.1109\/LCN.2013.6761301"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Benzel, T., Braden, R., Kim, D., Neuman, C., Joseph, A., Sklower, K., Ostrenga, R., and Schwab, S. (2006, January 1\u20133). Experience with deter: A testbed for security research. Proceedings of the 2nd International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, TRIDENTCOM, Barcelona, Spain.","DOI":"10.1109\/TRIDNT.2006.1649172"},{"key":"ref_55","unstructured":"Richmond, M. (2020, December 11). ViSe: A virtual security testbed. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.90.2205&rep=rep1&type=pdf."},{"key":"ref_56","unstructured":"Marrocco, D. (2018). Design and Deployment of a Virtual Environment to Emulate a Scada Network within Cyber Ranges. [Ph.D. Thesis, Politecnico di Torino]."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Ten, C.W., Liu, C.C., and Govindarasu, M. (2007, January 24\u201328). Vulnerability assessment of cybersecurity for SCADA systems using attack trees. Proceedings of the 2007 IEEE Power Engineering Society General Meeting, Tampa, FL, USA.","DOI":"10.1109\/PES.2007.385876"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Russo, E., Costa, G., and Armando, A. (2018, January 1\u20133). Scenario design and validation for next generation cyber ranges. Proceedings of the 2018 IEEE 17th International Symposium on Network Computing and Applications (NCA), Cambridge, MA, USA.","DOI":"10.1109\/NCA.2018.8548324"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Binz, T., Breitenb\u00fccher, U., Kopp, O., and Leymann, F. (2014). TOSCA: Portable automated deployment and management of cloud applications. Advanced Web Services, Springer.","DOI":"10.1007\/978-1-4614-7535-4_22"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"101837","DOI":"10.1016\/j.cose.2020.101837","article-title":"Building Next Generation Cyber Ranges with CRACK","volume":"95","author":"Russo","year":"2020","journal-title":"Comput. Secur."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.cose.2017.12.007","article-title":"ADLES: Specifying, deploying, and sharing hands-on cyber-exercises","volume":"74","author":"Goes","year":"2018","journal-title":"Comput. Secur."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1016\/S0167-4048(99)80115-1","article-title":"Simulating cyber attacks, defences, and consequences","volume":"18","author":"Cohen","year":"1999","journal-title":"Comput. Secur."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Park, J.S., Lee, J.S., Kim, H.K., Jeong, J.R., Yeom, D.B., and Chi, S.D. (2001, January 13\u201316). Secusim: A tool for the cyber-attack simulation. Proceedings of the International Conference on Information and Communications Security, Xi\u2019an, China.","DOI":"10.1007\/3-540-45600-7_53"},{"key":"ref_64","first-page":"97","article-title":"Defending a new domain-the Pentagon\u2019s cyberstrategy","volume":"89","author":"Lynn","year":"2010","journal-title":"Foreign Aff."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"817","DOI":"10.1016\/j.ijepes.2018.07.058","article-title":"Implementation and development of an offline co-simulation testbed for studies of power systems cyber security and control verification","volume":"104","author":"Hammad","year":"2019","journal-title":"Int. J. Electr. Power Energy Syst."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.ijepes.2017.01.016","article-title":"Real-time cyber physical system testbed for power system security and control","volume":"90","author":"Poudel","year":"2017","journal-title":"Int. J. Electr. Power Energy Syst."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"101648","DOI":"10.1016\/j.cose.2019.101648","article-title":"Design and implementation of automated IoT security testbed","volume":"88","author":"Waraga","year":"2020","journal-title":"Comput. Secur."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"106889","DOI":"10.1016\/j.comnet.2019.106889","article-title":"SODA: A software-defined security framework for IoT environments","volume":"163","author":"Kim","year":"2019","journal-title":"Comput. Netw."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"4506","DOI":"10.1007\/s11227-017-2219-z","article-title":"Design and implementation of cybersecurity testbed for industrial IoT systems","volume":"74","author":"Lee","year":"2018","journal-title":"J. Supercomput."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"105898","DOI":"10.1016\/j.ijepes.2020.105898","article-title":"Distributed control of heterogeneous energy storage systems in islanded microgrids: Finite-time approach and cyber-physical implementation","volume":"119","author":"Wang","year":"2020","journal-title":"Int. J. Electr. Power Energy Syst."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.jnca.2019.02.022","article-title":"Implementation of deep packet inspection in smart grids and industrial Internet of Things: Challenges and opportunities","volume":"135","author":"Rad","year":"2019","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Kumar, A., and Lim, T.J. (2018, January 1\u20133). A Secure Contained Testbed for Analyzing IoT Botnets. Proceedings of the International Conference on Testbeds and Research Infrastructures, Shanghai, China.","DOI":"10.1007\/978-3-030-12971-2_8"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1016\/j.cose.2018.05.002","article-title":"Virtualization of SCADA testbeds for cybersecurity research: A modular approach","volume":"77","author":"Alves","year":"2018","journal-title":"Comput. Secur."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.comnet.2018.01.026","article-title":"A framework for experimenting ICN over SDN solutions using physical and virtual testbeds","volume":"134","author":"Siracusano","year":"2018","journal-title":"Comput. Netw."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.comnet.2017.03.012","article-title":"Thorough IoT testbed characterization: From proof-of-concept to repeatable experimentations","volume":"119","author":"Papadopoulos","year":"2017","journal-title":"Comput. Netw."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1016\/j.jmsy.2017.04.004","article-title":"Cyber-physical manufacturing cloud: Architecture, virtualization, communication, and testbed","volume":"43","author":"Liu","year":"2017","journal-title":"J. Manuf. Syst."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.compeleceng.2017.02.010","article-title":"Monitoring system reaction in cyber-physical testbed under cyber-attacks","volume":"59","author":"Bernieri","year":"2017","journal-title":"Comput. Electr. Eng."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"680","DOI":"10.1016\/j.procs.2016.04.151","article-title":"Developing a distributed software defined networking testbed for IoT","volume":"83","author":"Flauzac","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"Ashok, A., Sridhar, S., McKinnon, A.D., Wang, P., and Govindarasu, M. (2016, January 16\u201318). Testbed-based performance evaluation of attack resilient control for AGC. Proceedings of the 2016 Resilience Week (RWS), Chicago, IL, USA.","DOI":"10.1109\/RWEEK.2016.7573319"},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Deshmukh, P.P., Patterson, C.D., and Baumann, W.T. (2016, January 12\u201315). A hands-on modular laboratory environment to foster learning in control system security. Proceedings of the 2016 IEEE Frontiers in Education Conference (FIE), Erie, PA, USA.","DOI":"10.1109\/FIE.2016.7757669"},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"2744","DOI":"10.1109\/TSG.2016.2537210","article-title":"WAMS cyber-physical test bed for power system, cybersecurity study, and data mining","volume":"8","author":"Adhikari","year":"2016","journal-title":"IEEE Trans. Smart Grid"},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Ashok, A., Wang, P., Brown, M., and Govindarasu, M. (2015, January 26\u201330). Experimental evaluation of cyber attacks on automatic generation control using a CPS security testbed. Proceedings of the 2015 IEEE Power & Energy Society General Meeting, Denver, CO, USA.","DOI":"10.1109\/PESGM.2015.7286615"},{"key":"ref_83","unstructured":"Bauer, S.W. (2020, December 11). What Is Classical Education?. Available online: http:\/\/www.bluegrasschristianacademy.org\/wp-content\/uploads\/2015\/06\/Classical-Education-_-The-Well-Trained-Mind.pdf."},{"key":"ref_84","doi-asserted-by":"crossref","unstructured":"Brynielsson, J., Franke, U., and Varga, S. (2016). Cyber situational awareness testing. Combatting Cybercrime and Cyberterrorism, Springer.","DOI":"10.1007\/978-3-319-38930-1_12"},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"642","DOI":"10.17485\/ijst\/2015\/v8i7\/67760","article-title":"Learning cyber security through gamification","volume":"8","author":"Boopathi","year":"2015","journal-title":"Indian J. Sci. Technol."},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Adams, M., and Makramalla, M. (2015). Cybersecurity skills training: An attacker-centric gamified approach. Technol. Innov. Manag. Rev., 5.","DOI":"10.22215\/timreview\/861"},{"key":"ref_87","doi-asserted-by":"crossref","unstructured":"Moallem, A. (2019). From Cyber-Security Deception to Manipulation and Gratification Through Gamification. HCI for Cybersecurity, Privacy and Trust, Springer International Publishing.","DOI":"10.1007\/978-3-030-22351-9"},{"key":"ref_88","unstructured":"Sadeh-Koniecpol, N., Wescoe, K., Brubaker, J., and Hong, J. (2017). Mock Attack Cybersecurity Training System and Methods. (US9558677), US Patent."},{"key":"ref_89","first-page":"1","article-title":"A role-based model for federal information technology\/cyber security training","volume":"800","author":"Toth","year":"2013","journal-title":"NIST Spec. Publ."},{"key":"ref_90","unstructured":"Glumich, S.M., and Kropa, B.A. (2020, December 11). Defex: Hands-On Cyber Defense Exercise for Undergraduate Students. Available online: https:\/\/apps.dtic.mil\/dtic\/tr\/fulltext\/u2\/a560055.pdf."},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Conklin, A. (2005, January 22\u201323). The use of a collegiate cyber defense competition in information security education. Proceedings of the 2nd Annual Conference on Information Security Curriculum Development, Kennesaw, GA, USA.","DOI":"10.1145\/1107622.1107627"},{"key":"ref_92","unstructured":"Dodge, R., and Ragsdale, D.J. (September, January 30). Organized cyber defense competitions. Proceedings of the IEEE International Conference on Advanced Learning Technologies, Joensuu, Finland."},{"key":"ref_93","unstructured":"Augustine, T., and Dodge, R.C. (2020, December 11). Cyber Defense Exercise: Meeting Learning Objectives Thru Competition. Available online: https:\/\/tinyurl.com\/y254qtj3."},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"Mattson, J.A. (2007, January 19\u201321). Cyber defense exercise: A service provider model. Proceedings of the Fifth World Conference on Information Security Education, West Point, NY, USA.","DOI":"10.1007\/978-0-387-73269-5_11"},{"key":"ref_95","unstructured":"Patriciu, V.V., and Furtuna, A.C. (2020, December 11). Guide for Designing Cyber Security Exercises. Available online: http:\/\/www.wseas.us\/e-library\/conferences\/2009\/tenerife\/EACT-ISP\/EACT-ISP-28.pdf."},{"key":"ref_96","unstructured":"Braje, T.M. (2016). Advanced Tools for Cyber Ranges, MIT Lincoln Laboratory. Technical report."},{"key":"ref_97","doi-asserted-by":"crossref","unstructured":"Talbot, J., Pikula, P., Sweetmore, C., Rowe, S., Hindy, H., Tachtatzis, C., Atkinson, R., and Bellekens, X. (2020, January 15\u201319). A Security Perspective on Unikernels. Proceedings of the 2020 International Conference on Cyber Security and Protection of Digital Services (Cyber Security), Dublin, Ireland.","DOI":"10.1109\/CyberSecurity49315.2020.9138883"},{"key":"ref_98","unstructured":"Pham, C.D. (2020, December 11). On Automatic Cyber Range Instantiation for Facilitating Security Training. Available online: https:\/\/dspace.jaist.ac.jp\/dspace\/bitstream\/10119\/14161\/3\/paper.pdf."},{"key":"ref_99","doi-asserted-by":"crossref","unstructured":"Eckroth, J., Chen, K., Gatewood, H., and Belna, B. (2019, January 18\u201320). Alpaca: Building Dynamic Cyber Ranges with Procedurally-Generated Vulnerability Lattices. Proceedings of the 2019 ACM Southeast Conference, Kennesaw, GA, USA.","DOI":"10.1145\/3299815.3314438"},{"key":"ref_100","unstructured":"Fok, C., Petz, A., Stovall, D., Paine, N., Julien, C., and Vishwanath, S. (2020, December 11). Pharos: A Testbed for Mobile Cyber-Physical Systems. Available online: https:\/\/www.cs.odu.edu\/~nadeem\/classes\/cs795-CPS-S13\/papers\/eval-001.pdf."},{"key":"ref_101","doi-asserted-by":"crossref","unstructured":"Deckard, G.M. (2018, January 23\u201324). Cybertropolis: Breaking the paradigm of cyber-ranges and testbeds. Proceedings of the 2018 IEEE International Symposium on Technologies for Homeland Security (HST), Woburn, MA, USA.","DOI":"10.1109\/THS.2018.8574134"},{"key":"ref_102","doi-asserted-by":"crossref","unstructured":"Tranoris, C., Denazis, S., Guardalben, L., Pereira, J., and Sargento, S. (June, January 27). Enabling Cyber-Physical Systems for 5G networking: A case study on the Automotive Vertical domain. Proceedings of the 2018 IEEE\/ACM 4th International Workshop on Software Engineering for Smart Cyber-Physical Systems (SEsCPS), Gothenburg, Sweden.","DOI":"10.1145\/3196478.3196481"},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"146057","DOI":"10.1109\/ACCESS.2019.2943837","article-title":"Cyber-security internals of a skoda octavia vRS: A hands on approach","volume":"7","author":"Urquhart","year":"2019","journal-title":"IEEE Access"},{"key":"ref_104","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.icte.2016.01.003","article-title":"5G mobile technology: A survey","volume":"1","author":"Mitra","year":"2015","journal-title":"ICT Express"},{"key":"ref_105","first-page":"1","article-title":"How 5G technology enables the health internet of things","volume":"3","author":"West","year":"2016","journal-title":"Brook. Cent. Technol. Innov."},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1109\/MCOM.2019.1900271","article-title":"The roadmap to 6G: AI empowered wireless networks","volume":"57","author":"Letaief","year":"2019","journal-title":"IEEE Commun. Mag."},{"key":"ref_107","doi-asserted-by":"crossref","unstructured":"Bhardwaj, A., and Krishna, C.R. (2019). A Container-Based Technique to Improve Virtual Machine Migration in Cloud Computing. IETE J. Res., 1\u201316.","DOI":"10.1080\/03772063.2019.1605848"},{"key":"ref_108","first-page":"165","article-title":"Weather model fine-tuning with software container-based simulation platform","volume":"123","author":"Lovas","year":"2019","journal-title":"IDOJ\u00c1R\u00c1S\/Q. J. Hung. Meteorol. Serv."},{"key":"ref_109","doi-asserted-by":"crossref","unstructured":"Mucci, D., and Blumbergs, B. (2020, December 11). TED: A Container Based Tool to Perform Security Risk Assessment for ELF Binaries. Available online: https:\/\/www.scitepress.org\/Papers\/2019\/73716\/73716.pdf.","DOI":"10.5220\/0007371603610369"},{"key":"ref_110","doi-asserted-by":"crossref","unstructured":"Kyriakou, A., and Sklavos, N. (2018, January 23\u201325). Container-based honeypot deployment for the analysis of malicious activity. Proceedings of the 2018 Global Information Infrastructure and Networking Symposium (GIIS), Thessaloniki, Greece.","DOI":"10.1109\/GIIS.2018.8635778"},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"1134","DOI":"10.1016\/j.future.2019.06.031","article-title":"Smart Cyber\u2013Physical Systems: Toward Pervasive Intelligence Systems","volume":"107","author":"Delicato","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3372823","article-title":"The ai-based cyber threat landscape: A survey","volume":"53","author":"Kaloudi","year":"2020","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_113","unstructured":"Brundage, M., Avin, S., Clark, J., Toner, H., Eckersley, P., Garfinkel, B., Dafoe, A., Scharre, P., Zeitzoff, T., and Filar, B. (2018). The malicious use of artificial intelligence: Forecasting, prevention, and mitigation. arXiv."},{"key":"ref_114","doi-asserted-by":"crossref","unstructured":"B\u00e9cue, A., Fourastier, Y., Pra\u00e7a, I., Savarit, A., Baron, C., Gradussofs, B., Pouille, E., and Thomas, C. (2018, January 13\u201315). CyberFactory# 1\u2014Securing the industry 4.0 with cyber-ranges and digital twins. Proceedings of the 2018 14th IEEE International Workshop on Factory Communication Systems (WFCS), Imperia, Italy.","DOI":"10.1109\/WFCS.2018.8402377"},{"key":"ref_115","unstructured":"Reys, N. (2020, December 11). Smart Cities and Cyber Threats, ControlRisks. Available online: https:\/\/www.controlrisks.com\/-\/media\/corporate\/files\/our-thinking\/insights\/smart-cities-and-cyber-threats\/smart-cities-article.pdf."},{"key":"ref_116","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.diin.2017.06.015","article-title":"Future challenges for smart cities: Cyber-security and digital forensics","volume":"22","author":"Baig","year":"2017","journal-title":"Digit. Investig."},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1016\/j.cose.2019.02.009","article-title":"Smart cities and cyber security: Are we there yet? A comparative study on the role of standards, third party risk management and security ownership","volume":"83","author":"Vitunskaite","year":"2019","journal-title":"Comput. Secur."},{"key":"ref_118","unstructured":"Mylrea, M. (2020, December 11). Singapore\u2019s Smart City: Securing It from Emerging Cyber Threats. Available online: https:\/\/dr.ntu.edu.sg\/handle\/10356\/80353."},{"key":"ref_119","doi-asserted-by":"crossref","unstructured":"Srivastava, S., Bisht, A., and Narayan, N. (2017, January 12\u201313). Safety and security in smart cities using artificial intelligence\u2014A review. Proceedings of the 2017 7th International Conference on Cloud Computing, Data Science & Engineering-Confluence, Noida, India.","DOI":"10.1109\/CONFLUENCE.2017.7943136"},{"key":"ref_120","doi-asserted-by":"crossref","first-page":"1086","DOI":"10.1016\/j.procs.2017.05.391","article-title":"Lo\u2019ai Tawalbeh Cyber security attacks on smart cities and associated mobile technologies","volume":"109","author":"AlDairi","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref_121","unstructured":"Cerrudo, C. (2020, December 11). Hacking Smart Cities. Available online: https:\/\/docs.huihoo.com\/rsaconference\/usa-2015\/hta-t10-hacking-smart-cities.pdf."},{"key":"ref_122","doi-asserted-by":"crossref","unstructured":"Alibasic, A., Al Junaibi, R., Aung, Z., Woon, W.L., and Omar, M.A. (2016, January 23). Cybersecurity for smart cities: A brief review. Proceedings of the International Workshop on Data Analytics for Renewable Energy Integration, Riva del Garda, Italy.","DOI":"10.1007\/978-3-319-50947-1_3"},{"key":"ref_123","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1016\/j.scs.2018.02.039","article-title":"Security and privacy challenges in smart cities","volume":"39","author":"Braun","year":"2018","journal-title":"Sustain. Cities Soc."},{"key":"ref_124","doi-asserted-by":"crossref","unstructured":"Wang, P., Ali, A., and Kelly, W. (2015, January 5\u20137). Data security and threat modeling for smart city infrastructure. Proceedings of the 2015 International Conference on Cyber Security of Smart Cities, Industrial Control System and Communications, (SSIC), Shanghai, China.","DOI":"10.1109\/SSIC.2015.7245322"},{"key":"ref_125","doi-asserted-by":"crossref","unstructured":"Farahat, I., Tolba, A., Elhoseny, M., and Eladrosy, W. (2019). Data security and challenges in smart cities. Security in Smart Cities: Models, Applications, and Challenges, Springer.","DOI":"10.1007\/978-3-030-01560-2_6"},{"key":"ref_126","doi-asserted-by":"crossref","unstructured":"Vattapparamban, E., G\u00fcven\u00e7, \u0130., Yurekli, A.\u0130., Akkaya, K., and Ulua\u011fa\u00e7, S. (2016, January 5\u20139). Drones for smart cities: Issues in cybersecurity, privacy, and public safety. Proceedings of the 2016 International Wireless Communications and Mobile Computing Conference (IWCMC), Paphos, Cyprus.","DOI":"10.1109\/IWCMC.2016.7577060"},{"key":"ref_127","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.tej.2017.04.003","article-title":"Deployment of cybersecurity for managing traffic efficiency and safety in smart cities","volume":"30","author":"Li","year":"2017","journal-title":"Electr. J."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/24\/7148\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:44:36Z","timestamp":1760179476000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/24\/7148"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,13]]},"references-count":127,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["s20247148"],"URL":"https:\/\/doi.org\/10.3390\/s20247148","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,13]]}}}