{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T22:35:51Z","timestamp":1772490951545,"version":"3.50.1"},"reference-count":61,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,5,23]],"date-time":"2024-05-23T00:00:00Z","timestamp":1716422400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The fast-paced evolution of technology has compelled the digitalization of education, requiring educators to interact with computers and develop digital competencies relevant to the teaching\u2013learning process. This need has prompted various organizations to define frameworks for assessing digital competency emphasizing teachers\u2019 interaction with computer technologies in education. Different authors have presented assessment methods for teachers\u2019 digital competence based on the video analysis of recorded classes using sensors such as cameras, microphones, or electroencephalograms. The main limitation of these solutions is the large number of resources they require, making it difficult to assess large numbers of teachers in resource-constrained environments. This article proposes the automation of teachers\u2019 digital competence evaluation process based on monitoring metrics obtained from teachers\u2019 interaction with a Learning Management System (LMS). Based on the Digital Competence Framework for Educators (DigCompEdu), indicators were defined and extracted that allow automatic measurement of a teacher\u2019s competency level. A tool was designed and implemented to conduct a successful proof of concept capable of automating the evaluation process of all university faculty, including 987 lecturers from different fields of knowledge. Results obtained allow for drawing conclusions on technological adoption according to the teacher\u2019s profile and planning educational actions to improve these competencies.<\/jats:p>","DOI":"10.3390\/s24113326","type":"journal-article","created":{"date-parts":[[2024,5,23]],"date-time":"2024-05-23T05:35:20Z","timestamp":1716442520000},"page":"3326","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Automated Monitoring of Human\u2013Computer Interaction for Assessing Teachers\u2019 Digital Competence Based on LMS Data Extraction"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9996-1941","authenticated-orcid":false,"given":"Eduard","family":"de-Torres","sequence":"first","affiliation":[{"name":"Human-Environment Research Group, Universitat Ramon Llull (URL), La Salle, 08022 Barcelona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xavi","family":"Canaleta","sequence":"additional","affiliation":[{"name":"Human-Environment Research Group, Universitat Ramon Llull (URL), La Salle, 08022 Barcelona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9471-153X","authenticated-orcid":false,"given":"David","family":"Fonseca","sequence":"additional","affiliation":[{"name":"Human-Environment Research Group, Universitat Ramon Llull (URL), La Salle, 08022 Barcelona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5525-4559","authenticated-orcid":false,"given":"Maria","family":"Alsina","sequence":"additional","affiliation":[{"name":"Human-Environment Research Group, Universitat Ramon Llull (URL), La Salle, 08022 Barcelona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"6695","DOI":"10.1007\/s10639-022-11431-8","article-title":"Impacts of Digital Technologies on Education and Factors Influencing Schools\u2019 Digital Capacity and Transformation: A Literature Review","volume":"28","author":"Timotheou","year":"2023","journal-title":"Educ. Inf. Technol."},{"key":"ref_2","unstructured":"Gilster, P. (1997). Digital Literacy, Wiley Computer Pub."},{"key":"ref_3","first-page":"6","article-title":"A New Digital Literacy: A Conversation with Paul Gilster","volume":"55","author":"Pool","year":"1997","journal-title":"Educ. Leadersh."},{"key":"ref_4","first-page":"21438","article-title":"Textual Practices in the New Media Digital Landscape: Messing with Digital Literacies","volume":"21","author":"Gourlay","year":"2013","journal-title":"Res. Learn. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.19030\/jier.v13i1.9907","article-title":"Digital Literacy Learning In Higher Education Through Digital Storytelling Approach","volume":"13","author":"Chan","year":"2017","journal-title":"JIER"},{"key":"ref_6","first-page":"095042221769783","article-title":"Digital Literacy in the Marketing Curriculum: Are Female College Students Prepared for Digital Jobs?","volume":"31","author":"Mishra","year":"2017","journal-title":"Ind. High. Educ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"39","DOI":"10.23865\/hu.v1.874","article-title":"Digital Competence in the Norwegian Teacher Education and School","volume":"1","author":"Krumsvik","year":"2011","journal-title":"H\u00f6gre Utbild."},{"key":"ref_8","first-page":"183","article-title":"Models and Instruments for Assessing Digital Competence at School","volume":"4","author":"Calvani","year":"2008","journal-title":"J. E-Learn. Knowl. Soc."},{"key":"ref_9","unstructured":"Guti\u00e9rrez Porl\u00e1n, I. (2011). Competencias Del Profesorado Universitario En Relaci\u00f3n Al Uso De Tecnolog\u00edas de la Informaci\u00f3n Y Comunicaci\u00f3n: An\u00e1lisis de la Situaci\u00f3n En Espa\u00f1a Y Propuesta De Un Modelo De Formaci\u00f3n. [Ph.D. Thesis, Universitat Rovira i Virgili]."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/2331186X.2018.1519143","article-title":"Digital Competence and Digital Literacy in Higher Education Research: Systematic Review of Concept Use","volume":"5","author":"Spante","year":"2018","journal-title":"Cogent Educ."},{"key":"ref_11","unstructured":"Punie, Y. (2017). European Framework for the Digital Competence of Educators: DigCompEdu, Publications Office of the European Union."},{"key":"ref_12","unstructured":"UNESCO (2018). UNESCO ICT Competency Framework for Teachers\u2014Version 3, United Nations Educational, Scientific and Cultural Organization."},{"key":"ref_13","unstructured":"(2024, February 28). International Society for Technology in Education (ISTE) ISTE Standards: For Educators. Available online: https:\/\/iste.org\/standards\/educators."},{"key":"ref_14","first-page":"78","article-title":"Adapting the 2008 NETS-T Standards for Use in Teacher Education: Part II","volume":"8","author":"Willis","year":"2012","journal-title":"Int. J. Technol. Teach. Learn."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1007\/s10209-017-0548-6","article-title":"Improving the Information Society Skills: Is Knowledge Accessible for All?","volume":"17","author":"Fonseca","year":"2018","journal-title":"Univ. Access Inf. Soc."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1080\/002202700182763","article-title":"Emerging Influences of Information Technology on School Curriculum","volume":"32","author":"Dede","year":"2000","journal-title":"J. Curric. Stud."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ghomi, M., and Redecker, C. (2019, January 2\u20134). Digital Competence of Educators (DigCompEdu): Development and Evaluation of a Self-Assessment Instrument for Teachers\u2019 Digital Competence. Proceedings of the 11th International Conference on Computer Supported Education, Heraklion, Crete, Greece.","DOI":"10.5220\/0007679005410548"},{"key":"ref_18","unstructured":"Ferrari, A., PUNIE, Y., and BRECKO, B. (2013). DIGCOMP: A Framework for Developing and Understanding Digital Competence in Europe, Publications Office of the European Union."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"102175","DOI":"10.1016\/j.ijinfomgt.2020.102175","article-title":"Information Management Research and Practice in the Post-COVID-19 World","volume":"55","author":"Barnes","year":"2020","journal-title":"Int. J. Inf. Manag."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1007\/s10734-020-00561-y","article-title":"COVID-19 and Digital Disruption in UK Universities: Afflictions and Affordances of Emergency Online Migration","volume":"81","author":"Watermeyer","year":"2021","journal-title":"High. Educ."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1002\/hbe2.201","article-title":"COVID-19 as an Accelerator for Digitalization at a German University: Establishing Hybrid Campuses in Times of Crisis","volume":"2","author":"Skulmowski","year":"2020","journal-title":"Hum. Behav. Emerg. Technol."},{"key":"ref_22","first-page":"415","article-title":"Usos y desusos del modelo GPT-3 entre estudiantes de grados de ingenier\u00eda","volume":"Volume 8","author":"Amo","year":"2023","journal-title":"Proceedings of the Actas de las XXIX Jornadas sobre Ense\u00f1anza Universitaria de la Inform\u00e1tica;"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"15873","DOI":"10.1007\/s10639-023-11834-1","article-title":"Large Language Models in Education: A Focus on the Complementary Relationship between Human Teachers and ChatGPT","volume":"28","author":"Jeon","year":"2023","journal-title":"Educ. Inf. Technol."},{"key":"ref_24","first-page":"47","article-title":"Emerging Technologies in K-12 Education: A Future HCI Research Agenda","volume":"30","author":"Smith","year":"2023","journal-title":"ACM Trans. Comput. -Hum. Interact."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"104703","DOI":"10.1016\/j.compedu.2022.104703","article-title":"What Matters in AI-Supported Learning: A Study of Human-AI Interactions in Language Learning Using Cluster Analysis and Epistemic Network Analysis","volume":"194","author":"Wang","year":"2023","journal-title":"Comput. Educ."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1017","DOI":"10.1111\/j.1467-9620.2006.00684.x","article-title":"Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge","volume":"108","author":"Mishra","year":"2006","journal-title":"Teach. Coll. Rec."},{"key":"ref_27","first-page":"60","article-title":"What Is Technological Pedagogical Content Knowledge (TPACK)?","volume":"9","author":"Koehler","year":"2009","journal-title":"Contemp. Issues Technol. Teach. Educ."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.17763\/haer.57.1.j463w79r56455411","article-title":"Knowledge and Teaching:Foundations of the New Reform","volume":"57","author":"Shulman","year":"2011","journal-title":"Harv. Educ. Rev."},{"key":"ref_29","unstructured":"UNESCO (2011). UNESCO ICT Competency Framework for Teachers, United Nations Educational, Scientific and Cultural Organization."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"100044","DOI":"10.1016\/j.caeo.2021.100044","article-title":"Developing Instructional Technology Standards for Educators: A Design-Based Research Study","volume":"2","author":"Crompton","year":"2021","journal-title":"Comput. Educ. Open"},{"key":"ref_31","unstructured":"Tomczyk, L. (2021, January 23\u201324). Digital Literacy among Teachers\u2014Mapping Theoretical Frameworks: TPACK, DigCompEdu, UNESCO, NETS-T, DigiLit Leicester. Proceedings of the 38th International Business Information Management Association (IBIMA), Seville, Spain."},{"key":"ref_32","unstructured":"European Parliament (2006). Official Journal of the European Union, Publications Office of the European Union."},{"key":"ref_33","unstructured":"INTEF (2017). Marco de Referencia de La Competencia Digital Docente, Instituto Nacional de Tecnolog\u00edas Educativas y Formaci\u00f3n del Profesorado."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Hu, M., Wei, Y., Li, M., Yao, H., Deng, W., Tong, M., and Liu, Q. (2022). Bimodal Learning Engagement Recognition from Videos in the Classroom. Sensors, 22.","DOI":"10.3390\/s22165932"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Rathod, M., Dalvi, C., Kaur, K., Patil, S., Gite, S., Kamat, P., Kotecha, K., Abraham, A., and Gabralla, L.A. (2022). Kids\u2019 Emotion Recognition Using Various Deep-Learning Models with Explainable AI. Sensors, 22.","DOI":"10.3390\/s22208066"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wang, Z., Li, L., Zeng, C., and Yao, J. (2023). Student Learning Behavior Recognition Incorporating Data Augmentation with Learning Feature Representation in Smart Classrooms. Sensors, 23.","DOI":"10.3390\/s23198190"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Fuentes-Martinez, V.J., Romero, S., Lopez-Gordo, M.A., Minguillon, J., and Rodr\u00edguez-\u00c1lvarez, M. (2023). Low-Cost EEG Multi-Subject Recording Platform for the Assessment of Students\u2019 Attention and the Estimation of Academic Performance in Secondary School. Sensors, 23.","DOI":"10.3390\/s23239361"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"10273","DOI":"10.3390\/s130810273","article-title":"Recognizing the Degree of Human Attention Using EEG Signals from Mobile Sensors","volume":"13","author":"Liu","year":"2013","journal-title":"Sensors"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Guo, J., Bai, L., Yu, Z., Zhao, Z., and Wan, B. (2021). An AI-Application-Oriented in-Class Teaching Evaluation Model by Using Statistical Modeling and Ensemble Learning. Sensors, 21.","DOI":"10.3390\/s21010241"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Sillat, L.H., Tammets, K., and Laanpere, M. (2021). Digital Competence Assessment Methods in Higher Education: A Systematic Literature Review. Educ. Sci., 11.","DOI":"10.3390\/educsci11080402"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2407","DOI":"10.1111\/bjet.12919","article-title":"Development and Validation of the DIGIGLO, a Tool for Assessing the Digital Competence of Educators","volume":"51","year":"2020","journal-title":"Br. J. Educ. Technol."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Guti\u00e9rrez-Castillo, J.J., Palacios-Rodr\u00edguez, A., Mart\u00edn-P\u00e1rraga, L., and Serrano-Hidalgo, M. (2023). Development of Digital Teaching Competence: Pilot Experience and Validation through Expert Judgment. Educ. Sci., 13.","DOI":"10.3390\/educsci13010052"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Cabero-Almenara, J., Guti\u00e9rrez-Castillo, J.J., Palacios-Rodr\u00edguez, A., and Barroso-Osuna, J. (2020). Development of the Teacher Digital Competence Validation of DigCompEdu Check-in Questionnaire in the University Context of Andalusia (Spain). Sustainability, 12.","DOI":"10.3390\/su12156094"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Rubio-Gragera, M., Cabero-Almenara, J., and Palacios-Rodr\u00edguez, A. (2023). Digital Innovation in Language Teaching\u2014Analysis of the Digital Competence of Teachers According to the DigCompEdu Framework. Educ. Sci., 13.","DOI":"10.3390\/educsci13040336"},{"key":"ref_45","unstructured":"Anastasia, E. (2023). SELFIEforTEACHERS. Designing and Developing a Self-Reflection Tool for Teachers\u2019 Digital Competence, Joint Research Centre (Seville site)."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2485","DOI":"10.1007\/s10639-022-11296-x","article-title":"Evaluation of Digital Competence Level among Educators in UAE Higher Education Institutions Using Digital Competence of Educators (DigComEdu) Framework","volume":"28","author":"Muammar","year":"2022","journal-title":"Educ. Inf. Technol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1186\/s41239-016-0009-y","article-title":"Delphi Study for the Design and Validation of a Questionnaire about Digital Competences in Higher Education","volume":"13","author":"Mira","year":"2016","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"250","DOI":"10.18261\/ISSN1891-943X-2014-04-03","article-title":"Development of Student Teachers\u2019 Digital Competence in Teacher Education\u2014A Literature Review","volume":"9","author":"Krumsvik","year":"2014","journal-title":"Nord. J. Digit. Lit."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1023\/A:1022193728205","article-title":"Cognitive Architecture and Instructional Design","volume":"10","author":"Sweller","year":"1998","journal-title":"Educ. Psychol. Rev."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Branson, R.K., Rayner, G.T., Cox, J.L., Furman, J.P., King, F.J., and Hannum, W.H. (1975). Interservice Procedures for Instructional Systems Development, U.S. Army Training and Doctrine Command.","DOI":"10.21236\/ADA023892"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Branch, R.M. (2010). Instructional Design: The ADDIE Approach, Springer. Instructional Design: The ADDIE Approach.","DOI":"10.1007\/978-0-387-09506-6"},{"key":"ref_52","unstructured":"Alsina, M., Canaleta, X., Torres Kompen, R., de Torres G\u00f3mez, E., and Fonseca Escudero, D. (2023). Influence of the Learning Trajectory on Academic Success when Using the Self Directed Based Learning Methodology. Educ. Knowl. Soc., 24."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"275","DOI":"10.7821\/naer.2020.7.578","article-title":"Evaluation of Teacher Digital Competence Frameworks Through Expert Judgement: The Use of the Expert Competence Coefficient","volume":"9","year":"2020","journal-title":"J. New Approaches Educ. Res."},{"key":"ref_54","first-page":"1","article-title":"Digital Competency Frames for university teachers: Evaluation through the expert competence coefficient","volume":"23","year":"2020","journal-title":"Rev. Electr\u00f3nica Interuniv. De Form. Del Profr."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"273","DOI":"10.5944\/educxx1.33520","article-title":"Assessment of Digital Teaching Competence: Instruments, results and proposals. Systematic literature review","volume":"26","year":"2023","journal-title":"Educ. XX1"},{"key":"ref_56","unstructured":"Yang, L., Garc\u00eda-Holgado, A., and Mart\u00ednez-Abad, F. (2021). Information Technology Trends for a Global and Interdisciplinary Research Community, IGI Global."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"10843","DOI":"10.1007\/s10639-022-11034-3","article-title":"DigComp-Based Digital Competence Assessment Tools: Literature Review and Instrument Analysis","volume":"27","author":"Mattar","year":"2022","journal-title":"Educ. Inf. Technol."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1186\/s41239-021-00312-8","article-title":"Teachers\u2019 Digital Competencies in Higher Education: A Systematic Literature Review","volume":"19","author":"Matarranz","year":"2022","journal-title":"Int. J. Educ. Technol. High Educ."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"276","DOI":"10.7821\/naer.2023.7.1452","article-title":"Digital Teaching Competence According to the DigCompEdu Framework. Comparative Study in Different Latin American Universities","volume":"12","year":"2023","journal-title":"J. New Approaches Educ. Res."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"100791","DOI":"10.1016\/j.edumed.2023.100791","article-title":"Comparison of the Teaching of Digital Competences between Health Science Faculties in Andalusia and Catalonia","volume":"24","year":"2023","journal-title":"Educ. M\u00e9dica"},{"key":"ref_61","first-page":"51","article-title":"Study of teachers\u2019 digital competence in Official Language Schools in Andalusia (Spain) and its relationships with gender and age variables","volume":"41","year":"2023","journal-title":"Aloma Rev. De Psicol. Ci\u00e8ncies De L\u2019educaci\u00f3 I De L\u2019esport"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/11\/3326\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:47:03Z","timestamp":1760107623000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/11\/3326"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,23]]},"references-count":61,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["s24113326"],"URL":"https:\/\/doi.org\/10.3390\/s24113326","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,23]]}}}