{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:52:42Z","timestamp":1760237562983,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2020,5,26]],"date-time":"2020-05-26T00:00:00Z","timestamp":1590451200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005367","name":"Universidad Nacional de Educaci\u00f3n a Distancia","doi-asserted-by":"publisher","award":["UNED; eNMoLabs"],"award-info":[{"award-number":["UNED; eNMoLabs"]}],"id":[{"id":"10.13039\/501100005367","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Our society is nowadays evolving towards a digital era, due to the extensive use of computer technologies and their interconnection mechanisms, i.e., social networks, Internet resources, IoT services, etc. This way, new threats and vulnerabilities appear. Therefore, there is an urgent necessity of training students in the topic of cybersecurity, in which practical skills have to be acquired. In distance education, the inclusion of on-line resources for hands-on activities in its curricula is a key step in meeting that need. This work presents several contributions. First, the fundamentals of a virtual remote laboratory hosted in the cloud are detailed. This laboratory is a step forward since the laboratory combines both virtualization and cloud paradigms to dynamically create emulated environments. Second, this laboratory has also been integrated into the practical curricula of a cybersecurity subject, as an additional on-line resource. Third, the students\u2019 traceability, in terms of their interactions with the laboratory, is also analyzed. Psychological TAM\/UTAUT factors (perceived usefulness, estimated effort, social influence, attitude, ease of access) that may affect the intention of using the laboratory are analyzed. Fourth, the degree of satisfaction is analyzed with a great impact, since the mean values of these factors are most of them higher than 4 points out of 5. In addition to this, the students\u2019 acceptance of the presented technology is exhaustively studied. Two structural equation models have been hypothesized and validated. Finally, the acceptance of the technology can be concluded as very good in order to be used in other Engineering contexts. In this sense, the calculated statistical values for the improved proposed model are within the expected ranges of reliability (X2 = 0.6, X2\/DF = 0.3, GFI = 0.985, CIF = 0.985, RMSEA = 0) by considering the literature.<\/jats:p>","DOI":"10.3390\/s20113011","type":"journal-article","created":{"date-parts":[[2020,5,28]],"date-time":"2020-05-28T12:36:58Z","timestamp":1590669418000},"page":"3011","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Emulating and Evaluating Virtual Remote Laboratories for Cybersecurity"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5181-0199","authenticated-orcid":false,"given":"Antonio","family":"Robles-G\u00f3mez","sequence":"first","affiliation":[{"name":"Department of Control and Communication Systems, Computer Science Engineering Faculty, Spanish National University for Distance Education (UNED), 28040 Madrid, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2779-4042","authenticated-orcid":false,"given":"Llanos","family":"Tobarra","sequence":"additional","affiliation":[{"name":"Department of Control and Communication Systems, Computer Science Engineering Faculty, Spanish National University for Distance Education (UNED), 28040 Madrid, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4089-9538","authenticated-orcid":false,"given":"Rafael","family":"Pastor-Vargas","sequence":"additional","affiliation":[{"name":"Department of Control and Communication Systems, Computer Science Engineering Faculty, Spanish National University for Distance Education (UNED), 28040 Madrid, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0967-0874","authenticated-orcid":false,"given":"Roberto","family":"Hern\u00e1ndez","sequence":"additional","affiliation":[{"name":"Department of Control and Communication Systems, Computer Science Engineering Faculty, Spanish National University for Distance Education (UNED), 28040 Madrid, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6926-1311","authenticated-orcid":false,"given":"Jes\u00fas","family":"Cano","sequence":"additional","affiliation":[{"name":"Department of Control and Communication Systems, Computer Science Engineering Faculty, Spanish National University for Distance Education (UNED), 28040 Madrid, Spain"},{"name":"Faculty of Law, San Pablo CEU University, 28003 Madrid, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2020,5,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Duan, Y. (2012, January 8\u201310). Value Modeling and Calculation for Everything as a Service (XaaS) Based on Reuse. Proceedings of the 13th International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel\/Distributed Computing (SNPD), Kyoto, Japan.","DOI":"10.1109\/SNPD.2012.30"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Martini, N., Farmer, K., Patil, S., Tan, G., Wang, C., Wong, L., and Webster, C.S. (2019). Designing and Evaluating a Virtual Patient Simulation\u2014The Journey from Uniprofessional to Interprofessional Learning. Information, 10.","DOI":"10.3390\/info10010028"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Juan, Y.K., Chen, H.H., and Chi, H.Y. (2018). Developing and Evaluating a Virtual Reality-Based Navigation System for Pre-Sale Housing Sales. Appl. Sci., 8.","DOI":"10.3390\/app8060952"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1016\/j.renene.2019.12.100","article-title":"Renewable energy remote online laboratories in Jordan universities: Tools for training students in Jordan","volume":"149","author":"Pastor","year":"2020","journal-title":"Renew. Energy"},{"key":"ref_5","first-page":"69","article-title":"Creation of Customized Remote Laboratories Using Deconstruction","volume":"10","author":"Tobarra","year":"2015","journal-title":"IEEE-RITA"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Dasgupta, D., Ferebee, D.M., and Michalewicz, Z. (2013, January 12\u201313). Applying Puzzle-Based Learning to Cyber-Security Education. Proceedings of the 2013 on InfoSecCD \u201913: Information Security Curriculum Development Conference, Kennesaw, GA, USA.","DOI":"10.1145\/2528908.2528910"},{"key":"ref_7","unstructured":"Martini, B., and Choo, K.K.R. (2014, January 9\u201311). Building the Next Generation of Cyber Security Professionals. Proceedings of the 22nd European Conference on Information Systems (ECIS 2014), Tel Aviv, Israel."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"21","DOI":"10.3200\/AEPR.109.4.21-32","article-title":"Critical Thinking: Why Is It So Hard to Teach?","volume":"109","author":"Willingham","year":"2008","journal-title":"Arts Educ. Policy Rev."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Hamari, J., Koivisto, J., and Sarsa, H. (2014, January 6\u20139). Does Gamification Work?\u2014A Literature Review of Empirical Studies on Gamification. Proceedings of the 2014 47th Hawaii International Conference on System Sciences, Waikoloa, HI, USA.","DOI":"10.1109\/HICSS.2014.377"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1109\/MCOM.2014.6979960","article-title":"Bringing an engineering lab into social sciences: didactic approach and an experiential evaluation","volume":"52","author":"Cano","year":"2014","journal-title":"IEEE Commun. Mag."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Cano, J., Hern\u00e1ndez, R., Ros, S., and Tobarra, L. (2016, January 24\u201326). A distributed laboratory architecture for game based learning in cybersecurity and critical infrastructures. Proceedings of the 2016 13th International Conference on Remote Engineering and Virtual Instrumentation (REV), Madrid, Spain.","DOI":"10.1109\/REV.2016.7444461"},{"key":"ref_12","unstructured":"(2020, April 30). EVE-ND, Emulated Virtual Environment\u2013Next Generation. Available online: http:\/\/www.eve-ng.net\/index.php\/downloads\/eve-ng."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Tobarra, L., Robles-G\u00f3mez, A., Pastor, R., Hern\u00e1ndez, R., Duque, A., and Cano, J. (2019). A Cybersecurity Experience with Cloud Virtual-Remote Laboratories. Proceedings, 31.","DOI":"10.3390\/proceedings2019031003"},{"key":"ref_14","unstructured":"Santos, O.C., Boticario, J.G., Raffenne, E., and Pastor, R. (2007, January 7\u20139). Why using dotLRN? UNED use cases. Proceedings of the FLOSS (Free\/Libre\/Open Source Systems) International Conference, Jerez de la Frontera, Spain."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"425","DOI":"10.2307\/30036540","article-title":"User Acceptance of Information Technology: Toward a Unified View","volume":"27","author":"Venkatesh","year":"2003","journal-title":"MIS Q."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.jbi.2009.07.002","article-title":"The Technology Acceptance Model: Its Past and Its Future in Health Care","volume":"43","author":"Holden","year":"2010","journal-title":"J. Biomed. Inform."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.compedu.2019.02.010","article-title":"Student acceptance of virtual laboratory and practical work: An extension of the technology acceptance model","volume":"135","author":"Estriegana","year":"2019","journal-title":"Comput. Educ."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Konak, A., Bartolacci, M.R., Kulturel-Konak, S., and Nasereddin, M. (2016, January 12\u201315). Impact of collaborative learning on student perception of virtual computer laboratories. Proceedings of the 2016 IEEE Frontiers in Education Conference (FIE), Erie, PA, USA.","DOI":"10.1109\/FIE.2016.7757640"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kim, S., Lee, K.H., Hwang, H., and Yoo, S. (2016). Analysis of the factors influencing healthcare professionals\u2019 adoption of mobile electronic medical record (EMR) using the unified theory of acceptance and use of technology (UTAUT) in a tertiary hospital. BMC Med Inform. Decis. Mak., 16.","DOI":"10.1186\/s12911-016-0249-8"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2913","DOI":"10.1049\/iet-com.2019.0554","article-title":"Optimising infrastructure as a service provider revenue through customer satisfaction and efficient resource provisioning in cloud computing","volume":"13","author":"Badshah","year":"2019","journal-title":"IET Commun."},{"key":"ref_21","first-page":"81","article-title":"Smart Security Framework for Educational Institutions Using Internet of Things (IoT)","volume":"61","author":"Badshah","year":"2019","journal-title":"Comput. Mater. Contin."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Mansoor, K., Ghani, A., Chaudhry, S.A., Shamshirband, S., Ghayyur, S.A.K., and Mosavi, A. (2019). Securing IoT-Based RFID Systems: A Robust Authentication Protocol Using Symmetric Cryptography. Sensors, 19.","DOI":"10.20944\/preprints201907.0298.v1"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1177\/0037549711434180","article-title":"SensGrid: modeling and simulation for wireless sensor grids","volume":"88","author":"Moreno","year":"2012","journal-title":"Simulation"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Rom\u00e1n-Ib\u00e1\u00f1ez, V., Pujol-L\u00f3pez, F.A., Mora-Mora, H., Pertegal-Felices, M.L., and Jimeno-Morenilla, A. (2018). A Low-Cost Immersive Virtual Reality System for Teaching Robotic Manipulators Programming. Sustainability, 10.","DOI":"10.3390\/su10041102"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Tawfik, M., Sancristobal, E., Martin, S., Diaz, G., and Castro, M. (2012, January 13\u201315). State-of-the-art remote laboratories for industrial electronics applications. Proceedings of the Conference on Technologies Applied to Electronics Teaching (TAEE), Vigo, Spain.","DOI":"10.1109\/TAEE.2012.6235465"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Shankar, B., Sarithlal, M., Vijayan, V., Freeman, J., and Achuthan, K. (2013, January 28\u201330). Remote Triggered Solar Thermal Energy Parabolic Trough laboratory: Effective implementation and future possibilities for Virtual Labs. Proceedings of the 2013 IEEE International Conference on Control Applications (CCA), Hyderabad, India.","DOI":"10.1109\/CCA.2013.6662794"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Rao, P., Dinesh, P., Ilango, G., and Nagamani, C. (2013, January 20\u201322). Laboratory course on solar photovoltaic systems based on low cost equipment. Proceedings of the 2013 IEEE International Conference on MOOC Innovation and Technology in Education (MITE), Jaipur, India.","DOI":"10.1109\/MITE.2013.6756324"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Tobarra, L., Ros, S., Hern\u00e1ndez, R., Pastor, R., Robles-G\u00f3mez, A., Caminero, A.C., and Castro, M. (2014, January 26\u201328). Low-Cost Remote Laboratories for Renewable Energy in Distance Education. Proceedings of the 11th International Conference on Remote Engineering and Virtual Instrumentation (REV 2014), Porto, Portugal.","DOI":"10.1109\/REV.2014.6784235"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Al-Zoubi, A., Hammad, B., Ros, S., Tobarra, L., Hern\u00e1ndez, R., Pastor, R., and Castro, M. (2014, January 22\u201325). Remote laboratories for renewable energy courses at Jordan universities. Proceedings of the 2014 IEEE Frontiers in Education Conference (FIE) Proceedings, Madrid, Spain.","DOI":"10.1109\/FIE.2014.7044175"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Tobarra, L., Ros, S., Hern\u00e1ndez, R., Pastor, R., Castro, M., Al-Zoubi, A.Y., Hammad, B., Dmour, M., Robles-G\u00f3mez, A., and Caminero, A.C. (2015, January 21\u201324). Analysis of integration of remote laboratories for renewable energy courses at Jordan universities. Proceedings of the 2015 IEEE Frontiers in Education Conference (FIE), El Paso, TX, USA.","DOI":"10.1109\/FIE.2015.7344388"},{"key":"ref_31","first-page":"2112","article-title":"Laboratories as a Service (LaaS): Using Cloud Technologies in the Field of Education","volume":"19","author":"Pastor","year":"2013","journal-title":"J. UCS"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Tobarra, L., Robles-G\u00f3mez, A., Pastor, R., Hern\u00e1ndez, R., Cano, J., and L\u00f3pez, D. (2019). Web of Things Platforms for Distance Learning Scenarios in Computer Science Disciplines: A Practical Approach. Technologies, 7.","DOI":"10.3390\/technologies7010017"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Burgos, D. (2020). A Predictive System Informed by Students\u2019 Similar Behaviour. Sustainability, 12.","DOI":"10.3390\/su12020706"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1109\/TE.2011.2160544","article-title":"Using Virtualization and Automatic Evaluation: Adapting Network Services Management Courses to the EHEA","volume":"55","author":"Ros","year":"2012","journal-title":"IEEE Trans. Educ."},{"key":"ref_35","first-page":"9","article-title":"E-learning using Cloud Computing","volume":"1","author":"Bora","year":"2013","journal-title":"Int. J. Sci. Mod. Eng. (IJISME)"},{"key":"ref_36","unstructured":"IBM Corporation (2020, April 30). Cloud Computing Saves Time, Money and Shortens Production Cycle. Available online: http:\/\/www-935.ibm.com\/services\/in\/cio\/pdf\/dic03001usen.pdf."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Selviandro, N., and Hasibuan, Z. (2013). Cloud-Based E-Learning: A Proposed Model and Benefits by Using E-Learning Based on Cloud Computing for Educational Institution. Information and Communication Technology, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-642-36818-9_20"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1109\/TLT.2015.2470683","article-title":"VirTUal remoTe labORatories Management System (TUTORES): Using Cloud Computing to Acquire University Practical Skills","volume":"9","author":"Caminero","year":"2016","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_39","unstructured":"(2020, April 30). Global Online Science Labs for Inquiry Learning at School (Go-Lab Project). Available online: http:\/\/www.go-lab-project.eu\/."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Salmer\u00f3n-Manzano, E., and Manzano-Agugliaro, F. (2018). The Higher Education Sustainability through Virtual Laboratories: The Spanish University as Case of Study. Sustainability, 10.","DOI":"10.3390\/su10114040"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Tobarra, L., Robles-G\u00f3mez, A., Pastor, R., Hern\u00e1ndez, R., Duque, A., and Cano, J. (2020). Students\u2019 Acceptance and Tracking of a New Container-Based Virtual Laboratory. Appl. Sci., 10.","DOI":"10.3390\/app10031091"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1146\/annurev.so.03.080177.001033","article-title":"Structural Equation Models","volume":"3","author":"Bielby","year":"1977","journal-title":"Annu. Rev. Sociol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1016\/j.compedu.2009.09.009","article-title":"Extending the TAM model to explore the factors that affect Intention to Use an Online Learning Community","volume":"54","author":"Liu","year":"2010","journal-title":"Comput. Educ."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Luckie, M., Hyun, Y., and Huffaker, B. (2008). Traceroute Probe Method and Forward IP Path Inference. Proceedings of the 8th ACM SIGCOMM Conference on Internet Measurement (IMC \u201908), Association for Computing Machinery.","DOI":"10.1145\/1452520.1452557"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Shah, M., Ahmed, S., Saeed, K., Junaid, M., Khan, H. (2019, January 30\u201331). Penetration Testing Active Reconnaissance Phase\u2013Optimized Port Scanning With Nmap Tool. Proceedings of the 2019 2nd International Conference on Computing, Mathematics and Engineering Technologies (iCoMET), Sukkur, Pakistan.","DOI":"10.1109\/ICOMET.2019.8673520"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1250","DOI":"10.1111\/bjet.12199","article-title":"On the use of extended TAM to assess students\u2019 acceptance and intent to use third-generation learning management systems","volume":"46","author":"Ros","year":"2015","journal-title":"Br. J. Educ. Technol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1017\/S1138741600002031","article-title":"Leadership in Nonprofit Organizations of Nicaragua and El Salvador: A Study from the Social Identity Theory","volume":"12","author":"Cantisano","year":"2009","journal-title":"Span. J. Psychol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/11\/3011\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:32:33Z","timestamp":1760175153000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/11\/3011"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,26]]},"references-count":47,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["s20113011"],"URL":"https:\/\/doi.org\/10.3390\/s20113011","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,5,26]]}}}