{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T01:43:47Z","timestamp":1785721427655,"version":"3.56.0"},"reference-count":48,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,3,18]],"date-time":"2023-03-18T00:00:00Z","timestamp":1679097600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,18]],"date-time":"2023-03-18T00:00:00Z","timestamp":1679097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Athens University of Economics & Business"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int. J. Inf. Secur."],"published-print":{"date-parts":[[2023,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The need for effective training of cyber security personnel working in critical infrastructures and in the corporate has brought attention to the evolution of Cyber Ranges (CRs) as learning and training tools. Although CRs have been organized for many years, there is a lack of standards and common methodologies that facilitate their development and optimize their effectiveness. Aiming at strengthening cyber security education and research that utilize well designed CRs, we first analyze the CRs domain to identify key characteristics, strengths and fundamental weaknesses, and based on these outcomes we propose the Cyber Range Design Framework (CRDF), which includes the CR Architecture and the CR Life-Cycle. The CR Architecture presents the main components of CRDF compliant CRs, whereas the CR Life-Cycle presents the development phases of such approaches and the activities these phases embrace. CRDF builds on the Conceptual Framework for eLearning and Training (COFELET) and on the Exercise Life-Cycle. COFELET is particularly elaborated for the development of cyber security educational approaches, by adopting its design considerations that were based on widely adopted educational theories and approaches (e.g., scenario-based, reuse of elements). CRDF envisages the elaboration of CRs which optimize their impact, mitigate their weaknesses, and minimize their preparation and running costs. Under this prism, a preliminary appreciation of the CRDF approaches effectiveness is presented along with the expected outcomes of such approaches.\n<\/jats:p>","DOI":"10.1007\/s10207-023-00680-4","type":"journal-article","created":{"date-parts":[[2023,3,18]],"date-time":"2023-03-18T08:02:41Z","timestamp":1679126561000},"page":"1005-1027","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":45,"title":["Cyber range design framework for cyber security education and training"],"prefix":"10.1007","volume":"22","author":[{"given":"M. N.","family":"Katsantonis","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"A.","family":"Manikas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"I.","family":"Mavridis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"D.","family":"Gritzalis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,3,18]]},"reference":[{"key":"680_CR1","unstructured":"Malekos Smith, Z., Lostri, E.: The hidden costs of cybercrime (2020). https:\/\/www.mcafee.com\/enterprise\/en-us\/assets\/reports\/rphidden-costs-of-cybercrime.pdf. Accessed 20 Oct 2022"},{"key":"680_CR2","unstructured":"Morgan, S.: Cybercrime to cost the world \\$10.5 trillion annually by 2025 (2020). https:\/\/cybersecurityventures.com\/cybercrime-damagecosts-10-trillion-by-2025\/. Accessed 20 Oct 2022"},{"key":"680_CR3","unstructured":"International Information System Security Certification Consortium (ISC). A resilient cybersecurity profession charts the path forward (2021). https:\/\/www.isc2.org\/-\/media\/ISC2\/Research\/2021\/ISC2-Cybersecurity-Workforce-Study-2021.ashx. Accessed 21 Oct 2022"},{"key":"680_CR4","doi-asserted-by":"publisher","unstructured":"Vykopal, J., et al.: Lessons learned from complex hands-on defence exercises in a cyber range. In: 2017 IEEE Frontiers in Education Conference (FIE). IEEE, Indianapolis, IN (2017). https:\/\/doi.org\/10.1109\/fie.2017.8190713","DOI":"10.1109\/fie.2017.8190713"},{"key":"680_CR5","unstructured":"National Institute of Standards and Technology (NIST): The cyber range\u2014a guide (2020). https:\/\/www.nist.gov\/system\/files\/documents\/2020\/06\/25\/The%20Cyber%20Range%20-%20A%20Guide%20%28NISTNICE%29%20%28Draft%29%20-%20062420_1315.pdf. Accessed 20 Oct 2022"},{"key":"680_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.cose.2022.102635","volume":"116","author":"MM Yamin","year":"2022","unstructured":"Yamin, M.M., Katt, B.: Modeling and executing cyber security exercise scenarios in cyber ranges. Comput. Secur. 116, 102635 (2022). https:\/\/doi.org\/10.1016\/j.cose.2022.102635","journal-title":"Comput. Secur."},{"key":"680_CR7","doi-asserted-by":"publisher","unstructured":"Katsantonis, N.M., et al.: Conceptual framework for developing cyber security serious games. In: 2019 IEEE Global Engineering Education Conference (EDUCON). IEEE, Dubai, United Arab Emirates (2019). https:\/\/doi.org\/10.1109\/EDUCON.2019.8725061","DOI":"10.1109\/EDUCON.2019.8725061"},{"key":"680_CR8","doi-asserted-by":"publisher","DOI":"10.1016\/j.cose.2021.102263","volume":"105","author":"MN Katsantonis","year":"2021","unstructured":"Katsantonis, M.N., Mavridis, I., Gritzalis, D.: Design and evaluation of COFELET-based approaches for cyber security learning and training. Comput. Secur. 105, 102263 (2021). https:\/\/doi.org\/10.1016\/j.cose.2021.102263","journal-title":"Comput. Secur."},{"key":"680_CR9","doi-asserted-by":"crossref","unstructured":"Katsantonis, M., Mavridis, I.: Ontology-based modelling for cyber security e-learning and training. In: International Conference on Web-Based Learning. Springer, pp. 15\u201327 (2019)","DOI":"10.1007\/978-3-030-35758-0_2"},{"key":"680_CR10","unstructured":"European Cyber Security Organisation: Understanding cyber ranges: from hype to reality. Technical report (2020)"},{"key":"680_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.cose.2020.101837","volume":"95","author":"E Russo","year":"2020","unstructured":"Russo, E., Costa, G., Armando, A.: Building next generation cyber ranges with CRACK. Comput. Secur. 95, 101837 (2020). https:\/\/doi.org\/10.1016\/j.cose.2020.101837","journal-title":"Comput. Secur."},{"issue":"24","key":"680_CR12","doi-asserted-by":"publisher","first-page":"7148","DOI":"10.3390\/s20247148","volume":"20","author":"E Ukwandu","year":"2020","unstructured":"Ukwandu, E., et al.: A review of cyber-ranges and test-beds: current and future trends. Sensors (Basel) 20(24), 7148 (2020). https:\/\/doi.org\/10.3390\/s20247148","journal-title":"Sensors (Basel)"},{"key":"680_CR13","doi-asserted-by":"publisher","first-page":"101636","DOI":"10.1016\/j.cose.2019.101636","volume":"88","author":"MM Yamin","year":"2020","unstructured":"Yamin, M.M., Katt, B., Gkioulos, V.: Cyber ranges and security testbeds: scenarios, functions, tools and architecture. Comput. Secur. 88, 101636 (2020). https:\/\/doi.org\/10.1016\/j.cose.2019.101636. (ISSN: 0167-4048)","journal-title":"Comput. Secur."},{"key":"680_CR14","doi-asserted-by":"crossref","unstructured":"Pepper, S., Moore, G.: Topic maps. In: Encyclopedia of Library and Information, vol. 1, pp. 5247\u20135259 (2010)","DOI":"10.1081\/E-ELIS3-120044331"},{"key":"680_CR15","unstructured":"ISO (International Organization for Standardization) and IEC (International Electrotechnical Commission). ISO\/IEC 13250: Topic Maps, 2nd Edn (2002). http:\/\/xml.coverpages.org\/TM-iso13250-2nd-ed-v2.pdf. Accessed 22 Jan 2023"},{"key":"680_CR16","doi-asserted-by":"publisher","unstructured":"Rebecchi, F., et al.: A digital twin for the 5G era: the SPIDER cyber range (2022). https:\/\/doi.org\/10.5281\/zenodo.6347532","DOI":"10.5281\/zenodo.6347532"},{"key":"680_CR17","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.cose.2018.06.001","volume":"78","author":"B Razvan","year":"2018","unstructured":"Razvan, B., et al.: Integrated framework for hands-on cybersecurity training: CyTrONE. Comput. Secur. 78, 43\u201359 (2018). https:\/\/doi.org\/10.1016\/j.cose.2018.06.001. (ISSN: 0167-4048)","journal-title":"Comput. Secur."},{"key":"680_CR18","unstructured":"Davis, J., Magrath, S.: A survey of cyber ranges and testbeds executive. In: Defence Technical Information Center, Fort Belvoir (2013)"},{"issue":"4","key":"680_CR19","doi-asserted-by":"publisher","first-page":"1809","DOI":"10.3390\/app11041809","volume":"11","author":"N Chouliaras","year":"2021","unstructured":"Chouliaras, N., et al.: Cyber ranges and testbeds for education, training, and research. Appl. Sci. 11(4), 1809 (2021). https:\/\/doi.org\/10.3390\/app11041809","journal-title":"Appl. Sci."},{"key":"680_CR20","unstructured":"Priyadarshini, I.: Features and architecture of the modern cyber range: a qualitative analysis and survey. Ph.D. thesis, University of Delaware, Newark, DE, USA (2018)"},{"key":"680_CR21","unstructured":"Nicodeme, B.: Federated cyber range challenges. MA thesis, Universite Libre de Bruxelles, Belgium (2019)"},{"key":"680_CR22","unstructured":"Cambridge Dictionary. Federation. https:\/\/dictionary.cambridge.org\/dictionary\/english\/federation. Accessed 20 Oct 2022"},{"key":"680_CR23","unstructured":"Cyber-MAR. D2.1: State of the art cyber range technologies analysis (2020). https:\/\/www.cyber-mar.eu\/wp-content\/uploads\/2020\/06\/Cyber-MAR_D2.1_State-of-the-art-Cyber-range-technologies-analysis_v1.0.pdf. Accessed 20 Oct 2022"},{"key":"680_CR24","doi-asserted-by":"publisher","unstructured":"Nagarajan, A., et al.: Exploring game design for cybersecurity training. In: 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER). IEEE, Bangkok (2012). https:\/\/doi.org\/10.1109\/CYBER.2012.6392562","DOI":"10.1109\/CYBER.2012.6392562"},{"key":"680_CR25","doi-asserted-by":"publisher","unstructured":"Katsantonis, M., Fouliras, P., Mavridis, I.: Conceptual analysis of cyber security education based on live competitions. In: 2017 IEEE Global Engineering Education Conference (EDUCON). IEEE, Athens, Greece (2017). https:\/\/doi.org\/10.1109\/EDUCON.2017.7942934","DOI":"10.1109\/EDUCON.2017.7942934"},{"key":"680_CR26","doi-asserted-by":"publisher","unstructured":"Oslejsek, R., et al.: Evaluation of cyber defense exercises using visual analytics process. In: 2018 IEEE Frontiers in Education Conference (FIE). IEEE, San Jose, CA, USA (2018). https:\/\/doi.org\/10.1109\/fie.2018.8659299","DOI":"10.1109\/fie.2018.8659299"},{"key":"680_CR27","doi-asserted-by":"publisher","unstructured":"Urias, V.E., et al.: Cyber range infrastructure limitations and needs of tomorrow: a position paper. In: 2018 International Carnahan Conference on Security Technology (ICCST). IEEE, Montreal, QC (2018). https:\/\/doi.org\/10.1109\/ccst.2018.8585460","DOI":"10.1109\/ccst.2018.8585460"},{"key":"680_CR28","unstructured":"Braje, T.M.: Advanced tools for cyber ranges. Technical report, MIT Lincoln Laboratory Lexington, United States (2016)"},{"key":"680_CR29","volume-title":"Researching Information Systems and Computing","author":"BJ Oates","year":"2006","unstructured":"Oates, B.J.: Researching Information Systems and Computing. SAGE Publications Ltd, Thousand Oaks (2006)"},{"issue":"3","key":"680_CR30","doi-asserted-by":"publisher","first-page":"3","DOI":"10.17083\/ijsg.v8i3.437","volume":"8","author":"M Katsantonis","year":"2021","unstructured":"Katsantonis, M., Mavridis, I.: Evaluation of HackLearn COFELET game user experience for cybersecurity education. Int. J. Serious Games 8(3), 3\u201324 (2021). https:\/\/doi.org\/10.17083\/ijsg.v8i3.437","journal-title":"Int. J. Serious Games"},{"key":"680_CR31","unstructured":"UNESCO Institute for Statistics: International standard classification of education: ISCED 2011. In: Comparative Social Research, vol. 30 (2011)"},{"key":"680_CR32","unstructured":"ENISA: EU cybersecurity certification framework. https:\/\/www.enisa.europa.eu\/topics\/standards\/certification. Accessed 20 Oct 2022"},{"key":"680_CR33","unstructured":"Technopedia: What does platform mean? https:\/\/www.techopedia.com\/definition\/3411\/platform-computing. Accessed 20 Oct 2022"},{"key":"680_CR34","unstructured":"Chaskos, E.C.: Cyber-security training: a comparative analysis of cyberranges and emerging trends. MA thesis, National and Kapodistrian University of Athens, Athens (2019)"},{"key":"680_CR35","unstructured":"Foresight. D2.1 State of the Art Scenario Report (I) (2020). https:\/\/ec.europa.eu\/research\/participants\/documents\/downloadPublic?documentIds=080166e5de52f16b &appId=PPGMS. Accessed 20 Oct 2022"},{"key":"680_CR36","unstructured":"Disney, A.: Graph visualization use cases: cyber security (2017). https:\/\/cambridge-intelligence.com\/use-cases-graph-visualization-cybersecurity. Accessed 20 Oct 2022"},{"key":"680_CR37","unstructured":"US-Africa Cybersecurity Group (USAFCG): CR14 open cyber range: a resource to trial cyber security tools (2018). https:\/\/usafcg.com\/2018\/05\/15\/. Accessed 22 Oct 2022"},{"key":"680_CR38","doi-asserted-by":"publisher","unstructured":"Javali, C., Revadigar, G.: Network web traffic generator for cyber range exercises. In: 2019 IEEE 44th Conference on Local Computer Networks (LCN). IEEE, Osnabrueck, Germany (2019). https:\/\/doi.org\/10.1109\/lcn44214.2019.8990880","DOI":"10.1109\/lcn44214.2019.8990880"},{"key":"680_CR39","unstructured":"Ministry of Communications and Multimedia Malaysia (MCMM): Cyber range framework. https:\/\/www.cybersecurity.my\/data\/content_files\/26\/2249.pdf. Accessed 20 Oct 2022"},{"issue":"2","key":"680_CR40","first-page":"149","volume":"50","author":"E Pavlova","year":"2021","unstructured":"Pavlova, E.: Implementation of federated cyber ranges in bulgarian universities: challenges, requirements, and opportunities. Inf. Secur. Int. J. 50(2), 149\u2013159 (2021)","journal-title":"Inf. Secur. Int. J."},{"issue":"3","key":"680_CR41","first-page":"227","volume":"12","author":"C Peterson","year":"2003","unstructured":"Peterson, C.: Bringing ADDIE to life: instructional design at its best. J. Educ. Multimed. Hypermedia 12(3), 227\u2013241 (2003)","journal-title":"J. Educ. Multimed. Hypermedia"},{"key":"680_CR42","unstructured":"Allen, P.D., Straub, K.A.: Using games to enrich continuous cyber training. In: Johns Hopkins APL Technical Digest, vol. 33, no. 2 (2015)"},{"key":"680_CR43","unstructured":"Jones, R.M., et al.: Modeling and integrating cognitive agents within the emerging cyber domain. In: Proceedings of the Interservice\/Industry Training, Simulation, and Education Conference (I\/ITSEC), vol. 20. Citeseer (2015)"},{"issue":"3","key":"680_CR44","doi-asserted-by":"publisher","first-page":"304","DOI":"10.11610\/isij.4622","volume":"46","author":"M Tur\u010dan\u0131k","year":"2020","unstructured":"Tur\u010dan\u0131k, M.: A cyber range for Armed Forces Education. Inf. Secur. Int. J. 46(3), 304\u2013310 (2020). https:\/\/doi.org\/10.11610\/isij.4622","journal-title":"Inf. Secur. Int. J."},{"key":"680_CR45","unstructured":"Cyber security competence for Research and Innovation: Feasibility study \u201ccybersecurity skills certifications (2020). https:\/\/www.concordia-h2020.eu\/wp-content\/uploads\/2020\/06\/CONCORDIA-SkillsFeasibilityStudy-forpublication.pdf. Accessed 20 Oct 2022"},{"key":"680_CR46","doi-asserted-by":"publisher","unstructured":"Costa, G., Russo, E., Armando, A.: Automating the generation of cyber range virtual scenarios with VSDL. In: arXiv preprint arXiv:2001.06681 (2020). https:\/\/doi.org\/10.48550\/arXiv.2001.06681","DOI":"10.48550\/arXiv.2001.06681"},{"key":"680_CR47","unstructured":"Petrone, J.: CR14 open cyber range: a resource to trial cyber security tools (2020). https:\/\/e-estonia.com\/c14-a-resource-to-trial-cybersecurity-tools. Accessed 20 Oct 2022"},{"key":"680_CR48","unstructured":"Beauchamp, C.L.: Exploring cyber ranges in cybersecurity education. Ph.D. thesis, Virginia Tech (2022)"}],"container-title":["International Journal of Information Security"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10207-023-00680-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10207-023-00680-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10207-023-00680-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,26]],"date-time":"2023-07-26T01:07:44Z","timestamp":1690333664000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10207-023-00680-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,18]]},"references-count":48,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["680"],"URL":"https:\/\/doi.org\/10.1007\/s10207-023-00680-4","relation":{},"ISSN":["1615-5262","1615-5270"],"issn-type":[{"value":"1615-5262","type":"print"},{"value":"1615-5270","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,18]]},"assertion":[{"value":"18 March 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"None of the authors have received a speaker honorarium from any company. All authors declare that none of them has any conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"This article does not contain any studies with human participants or animals performed by any of the authors.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}]}}