{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T19:40:14Z","timestamp":1772048414839,"version":"3.50.1"},"reference-count":144,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2023,3,3]],"date-time":"2023-03-03T00:00:00Z","timestamp":1677801600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>This study investigated the crucial factors for measuring the success of the information system used in the e-learning process, considering the transformations in the work environment. This study was motivated by the changes caused by COVID-19 witnessed after the shift to fully online learning environments supported by e-learning systems, i.e., learning emphasized with information systems. Empirical research was conducted on a sample comprising teaching staff from two European universities: the University of Novi Sad, Faculty of Technical Sciences in Serbia and the Polytechnic Institute of Castelo Branco in Portugal. By synthesizing knowledge from review of the prior literature, supported by the findings of this study, the authors propose an Extended Information System Success Measurement Model\u2014EISSMM. EISSMM underlines the importance of workforce agility, which includes the factors of proactivity, adaptability, and resistance to change, in the information system performance measurement model. The results of our research provide more extensive evidence and findings for scholars and practitioners that could support measuring information system success primarily in e-learning and other various contextual settings, highlighting the importance of people\u2019s responses to work environment changes.<\/jats:p>","DOI":"10.3390\/app13053258","type":"journal-article","created":{"date-parts":[[2023,3,6]],"date-time":"2023-03-06T02:28:34Z","timestamp":1678069714000},"page":"3258","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["The Extended Information Systems Success Measurement Model: e-Learning Perspective"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5522-6558","authenticated-orcid":false,"given":"Teodora","family":"Vuckovic","sequence":"first","affiliation":[{"name":"Faculty of Technical Sciences, University of Novi Sad, 21000 Novi Sad, Serbia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9200-5092","authenticated-orcid":false,"given":"Darko","family":"Stefanovic","sequence":"additional","affiliation":[{"name":"Faculty of Technical Sciences, University of Novi Sad, 21000 Novi Sad, Serbia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4834-6487","authenticated-orcid":false,"given":"Danijela","family":"Ciric Lalic","sequence":"additional","affiliation":[{"name":"Faculty of Technical Sciences, University of Novi Sad, 21000 Novi Sad, Serbia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6810-2447","authenticated-orcid":false,"given":"Rog\u00e9rio","family":"Dionisio","sequence":"additional","affiliation":[{"name":"DiSAC R&D Unit, Polytechnic Institute of Castelo Branco, 6000-084 Castelo Branco, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0172-4679","authenticated-orcid":false,"given":"\u00c2ngela","family":"Oliveira","sequence":"additional","affiliation":[{"name":"DiSAC R&D Unit, Polytechnic Institute of Castelo Branco, 6000-084 Castelo Branco, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5951-563X","authenticated-orcid":false,"given":"Djordje","family":"Przulj","sequence":"additional","affiliation":[{"name":"Faculty of Technical Sciences, University of Novi Sad, 21000 Novi Sad, Serbia"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1287\/isre.3.1.60","article-title":"Information Systems Success: The Quest for the Dependent Variable","volume":"3","author":"DeLone","year":"1992","journal-title":"Inf. Syst. Res."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"425","DOI":"10.2307\/30036540","article-title":"User Acceptance of Information Technology: Toward a Unified View","volume":"27","author":"Venkatesh","year":"2003","journal-title":"MIS Q."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1108\/14684521111113597","article-title":"E-learning motivation and educational portal acceptance in developing countries","volume":"35","author":"Maldonado","year":"2011","journal-title":"Online Inf. Rev."},{"key":"ref_4","unstructured":"Loli\u0107, T., Risti\u0107, S., Stefanovi\u0107, D., and Marjanovi\u0107, U. (2018, January 19\u201321). Acceptance of E-Learning System at Faculty of Technical Sciences. Proceedings of the Cental European Conference on Information and Intelligent Systems, Varazdin, Croatia."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lolic, T., Dionisio, R., Ciric, D., Ristic, S., and Stefanovic, D. (2020, January 8\u201311). Factors Influencing Students Usage of an e-Learning System: Evidence from IT Students. Proceedings of the International Joint Conference on Industrial Engineering and Operations Management\u2014IJCIEOM, Rio de Janeiro, Brazil.","DOI":"10.1007\/978-3-030-43616-2_22"},{"key":"ref_6","first-page":"785","article-title":"Assessing Engineering Students\u2019 Acceptance of an E-Learning System: A Longitudinal Study","volume":"37","author":"Lolic","year":"2021","journal-title":"Int. J. Eng. Educ."},{"key":"ref_7","first-page":"573","article-title":"Information Technology for Development Information system success among manufacturing SMEs: Case of developing countries","volume":"21","author":"Ghobakhloo","year":"2015","journal-title":"J. Assoc. Inf. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1016\/j.giq.2007.06.002","article-title":"Assessing eGovernment systems success: A validation of the DeLone and McLean model of information systems success","volume":"25","author":"Wang","year":"2008","journal-title":"Gov. Inf. Q."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1111\/j.1540-5915.2008.00192.x","article-title":"Technology Acceptance Model 3 and a Research Agenda on Interventions","volume":"39","author":"Venkatesh","year":"2008","journal-title":"Dec. Sci."},{"key":"ref_10","first-page":"328","article-title":"Unified Theory of Acceptance and Use of Technology: A Synthesis and the Road Ahead","volume":"17","author":"Venkatesh","year":"2016","journal-title":"J. Assoc. Inf. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"157","DOI":"10.2307\/41410412","article-title":"Consumer Acceptance and Use of Information Technology: Extending the Unified Theory of Acceptance and Use of Technology","volume":"36","author":"Venkatesh","year":"2012","journal-title":"Mis Q."},{"key":"ref_12","unstructured":"Forrester (2019). IT Spending Forecasts, Forrester."},{"key":"ref_13","unstructured":"Gartner (2019). Gartner Worldwide IT Spending Forecast Available, Gartner Inc."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1080\/02683960110132070","article-title":"Workforce agility: The new employee strategy for the knowledge economy","volume":"17","author":"Breu","year":"2001","journal-title":"J. Inf. Technol."},{"key":"ref_15","unstructured":"Stefanovic, D. (2012). Prilog Istra\u017eivanju Uslova za Integraciju Savremenih Ict u Poslovanju Industrijskih Proizvodno\u2014Poslovnih Sistema. [Ph.D. Thesis, Univerzitet u Novom Sadu]."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1080\/07421222.2003.11045748","article-title":"The DeLone and McLean model of information systems success: A ten-year update","volume":"19","author":"DeLone","year":"2003","journal-title":"J. Manag. Inf. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"319","DOI":"10.2307\/249008","article-title":"Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology","volume":"19","author":"Davis","year":"1989","journal-title":"MIS Q."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1287\/mnsc.46.2.186.11926","article-title":"Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies","volume":"46","author":"Venkatesh","year":"2000","journal-title":"Manag. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/0749-5978(91)90020-T","article-title":"The Theory of Planned Behavior","volume":"50","author":"Ajzen","year":"1991","journal-title":"Organ. Behav. Hum. Decis. Process"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"145","DOI":"10.2307\/249749","article-title":"Social Cognitive Theory and Individual Reactions to Computing Technology","volume":"23","author":"Compeau","year":"1999","journal-title":"MIS Q."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1007\/s12528-010-9032-5","article-title":"The role of involvement in learning management system success","volume":"22","author":"Klobas","year":"2010","journal-title":"J. Comput. High. Educ."},{"key":"ref_22","first-page":"224","article-title":"Measuring Electronic Government Procurement Success and Testing for the Moderating Effect of Computer Self-efficacy","volume":"4","author":"Jang","year":"2010","journal-title":"Int. J. Digit. Content Technol. Its Appl."},{"key":"ref_23","unstructured":"Janssen, M., Lamersdorf, W., Pries-Heje, J., and Rosemann, M. (2010, January 20\u201323). E-Government. E-Services and Global processes. Proceedings of the Joint IFIP TC 8 and TC 6 International Conferences, EGES 2010 and GISP 2010, Held as Part of WCC 2010, Brisbane, Australia."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1097\/NCN.0b013e31821a1651","article-title":"Exploring nursing e-learning systems success based on information system success model","volume":"29","author":"Chang","year":"2011","journal-title":"Comp. Inf. Nurs."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.ijinfomgt.2009.03.013","article-title":"Measuring the success of the Greek Taxation Information System","volume":"30","author":"Floropoulos","year":"2010","journal-title":"Int. J. Inf. Manag."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Chen, Y., and Chu, P. (2012). Electronic Governance and Cross-Boundary Collaboration: Innovations and Advancing Tools, IGI Global.","DOI":"10.4018\/978-1-60960-753-1"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Alkhalaf, S., Nguyen, A., Drew, S., and Jones, V. (2013, January 16\u201317). Measuring the Information Quality of e-Learning Systems in KSA: Attitudes and Perceptions of Learners. Proceedings of the Robot Intelligence Technology and Applications 2012, Advances in Intelligent Systems and Computing, Berlin, Germany.","DOI":"10.1007\/978-3-642-37374-9_75"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Visser, M., Biljon, J.V., and Herselman, M. (2012, January 1\u20133). Modeling management information systems\u2019 success. Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference, Pretoria, South Africa.","DOI":"10.1145\/2389836.2389881"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"36","DOI":"10.4018\/jissc.2010040103","article-title":"DeLone & McLean IS Success Model in Evaluating Knowledge Transfer in a Virtual Learning Environment","volume":"1","author":"Halonen","year":"2010","journal-title":"Int. J. Inf. Syst. Soc. Chang."},{"key":"ref_30","unstructured":"Abdelsalam, H., Reddick, C., and Kadi, H. (2012). Managing E-Government Projects: Concepts, Issues and Best Practices, IGI Global."},{"key":"ref_31","first-page":"31","article-title":"Assessing e-Excise sucess with Delone and Mclean\u2019s model","volume":"52","author":"Khayun","year":"2012","journal-title":"J. Comput. Inf. Syst."},{"key":"ref_32","first-page":"1","article-title":"Examining success factors of open source software repositories: The case of OSOR.eu portal","volume":"14","author":"Hollmann","year":"2013","journal-title":"Int. J. Bus. Inf. Syst."},{"key":"ref_33","first-page":"4","article-title":"Critical success factors for adoption of web-based learning management systems in Tanzania","volume":"10","author":"Lwoga","year":"2014","journal-title":"Int. J. Educ. Dev. Using Inf. Commun. Technol."},{"key":"ref_34","unstructured":"Komba, M.M., and Ngulube, P. (2014). Emerging Issues and Prospects in African E-Government, IGI Global."},{"key":"ref_35","first-page":"11","article-title":"Meta-analysis of the DeLone and McLean information systems success model at individual level: An examination of the heterogeneity of the studies","volume":"36","year":"2015","journal-title":"Espacios"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.1108\/EL-06-2014-0094","article-title":"Development and evaluation of the mobile library service system success model A case study of Taiwan","volume":"33","author":"Huang","year":"2015","journal-title":"Electron. Libr."},{"key":"ref_37","first-page":"18155","article-title":"The influence of information system success factors towards user satisfaction in universiti teknikal Malaysia Melaka","volume":"10","author":"Arshad","year":"2015","journal-title":"J. Eng. Appl. Sci."},{"key":"ref_38","first-page":"67","article-title":"Analysis of Relationship between Three Dimensions of Quality, User Satisfaction, and E-Learning Usage of Binus Online Learning","volume":"9","author":"Yosep","year":"2015","journal-title":"Comm. Inf. Technol. J."},{"key":"ref_39","unstructured":"Seyal, A.H., Rahman, M.N.A., Zurainah, A., and Tazrajiman, S. (2015, January 11\u201315). Evaluating User Satisfaction with Bruneian E-Government Website: A Case of e-Darussalam. Proceedings of the 26th IBIMA Conference, Madrid, Spain."},{"key":"ref_40","first-page":"1","article-title":"An Empirical Test of Information System Success Model in a University\u2019s Electronic Services","volume":"10","author":"Khudhair","year":"2016","journal-title":"Adv. Nat. Appl. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1108\/IJILT-06-2015-0019","article-title":"Assessing users satisfaction with web digital library: The case of Universiti Teknologi MARA","volume":"33","author":"Masrek","year":"2016","journal-title":"Int. J. Inf. Learn. Technol."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Gorla, N., and Chiravuri, A. (2016, January 7\u20138). Developing electronic government success models for G2C and G2B scenarios. Proceedings of the 2016 International Conference on Information Management ICIM 2016, London, UK.","DOI":"10.1109\/INFOMAN.2016.7477527"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1177\/0961000617726123","article-title":"Modelling digital library success using the DeLone and McLean information system success model","volume":"51","author":"Alzahrani","year":"2019","journal-title":"J. Librariansh. Inf. Sci."},{"key":"ref_44","first-page":"3587","article-title":"The path of new information technology affecting educational equality in the new digital divide-based on information system success model","volume":"13","author":"Zheng","year":"2017","journal-title":"Eurasia J. Math. Sci. Technol. Educ."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1504\/IJMLO.2017.080893","article-title":"The influence of service quality in information system success model as an antecedent of mobile learning in education organizations: Case study in Jordan","volume":"11","year":"2017","journal-title":"Int. J. Mob. Learn. Organ."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Santos, A.D., Santoso, A.J., and Setyohadi, D.B. (2017, January 7\u20138). The analysis of academic information system success: A case study at Instituto Profissional de Canossa (IPDC) Dili timor-leste. Proceedings of the 2017 International Conference on Soft Computing, Intelligent System and Information Technology, Thessaloniki, Greece.","DOI":"10.1109\/ICSIIT.2017.14"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1007\/s12208-016-0164-9","article-title":"E-government: A citizen relationship marketing analysis","volume":"14","author":"Wirtz","year":"2017","journal-title":"Int. Rev. Public Nonprofit Mark."},{"key":"ref_48","unstructured":"Hassan, N.S., and Seyal, A.H. (2015, January 16\u201317). Measuring Success of Higher Education Centralised Administration Information System: An e-Government Initiative. Proceedings of the 15th European Conference on eGovernment 2015: ECEG 2015, Ljubljana, Slovenia."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1108\/IJILT-11-2017-0116","article-title":"An extension of Delone and McLean IS success model with self-efficacy: Online learning usage in Yemen","volume":"35","author":"Aldholay","year":"2018","journal-title":"Int. J. Inf. Learn. Technol."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1177\/0047239518795828","article-title":"What Makes Learning Management Systems Effective for Learning?","volume":"47","author":"Chaw","year":"2018","journal-title":"J. Educ. Technol. Syst."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1108\/EL-04-2017-0086","article-title":"Mediating effects of user experience usability: An empirical study on mobile library application in China","volume":"36","author":"Ke","year":"2018","journal-title":"Electron. Libr."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"75","DOI":"10.3991\/ijim.v13i05.9791","article-title":"Towards a model of quality features for mobile social networks apps in learning environments: An extended information system success model","volume":"13","author":"Alksasbeh","year":"2019","journal-title":"Int. J. Interact. Mob. Technol."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.procs.2019.11.119","article-title":"Effect of social media activities to determinants public participate intention of e-government","volume":"161","author":"Hariguna","year":"2019","journal-title":"Procedia Comput. Sci."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1016\/j.giq.2019.02.001","article-title":"Cross-boundary e-government systems: Determinants of performance","volume":"36","author":"Chen","year":"2019","journal-title":"Gov. Inf. Q."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Lee, E.Y., and Jeon, Y.J.J. (2020). The difference of user satisfaction and net benefit of a mobile learning management system according to self-directed learning: An investigation of cyber university students in hospitality. Sustainability, 12.","DOI":"10.3390\/su12072672"},{"key":"ref_56","first-page":"1909","article-title":"Delone and mclean model evaluation of information system success: A case study of master program of civil engineering universitas lambung mangkurat","volume":"29","author":"Dalle","year":"2020","journal-title":"Int. J. Adv. Sci. Technol."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1186\/s41239-020-00189-z","article-title":"Does sociability quality of web-based collaborative learning information system influence students\u2019 satisfaction and system usage?","volume":"17","author":"Salam","year":"2020","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_58","first-page":"26","article-title":"Perceptions of learning management system quality, satisfaction, and usage: Differences among students of the arts","volume":"36","author":"Koh","year":"2020","journal-title":"Australas. J. Educ. Technol."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.giq.2010.09.004","article-title":"Assessing citizen adoption of e-Government initiatives in Gambia: A validation of the technology acceptance model in information systems success","volume":"28","author":"Lin","year":"2011","journal-title":"Gov. Inf. Q."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1016\/j.compedu.2009.02.021","article-title":"An empirical study of instructor adoption of web-based learning systems","volume":"53","author":"Wang","year":"2009","journal-title":"Comput. Educ."},{"key":"ref_61","first-page":"730","article-title":"Acceptance of Mobile Learning: A Respecification and Validation of Information System Success","volume":"41","author":"Yi","year":"2009","journal-title":"Eng. Technol."},{"key":"ref_62","first-page":"80","article-title":"The success of learning management system among distance learners in Malaysian universities","volume":"21","author":"Almarashdeh","year":"2010","journal-title":"J. Theor. Appl. Inf. Technol."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.compedu.2011.07.008","article-title":"Antecedences to continued intentions of adopting e-learning system in blended learning instruction: A contingency framework based on models of information system success and task-technology fit","volume":"58","author":"Lin","year":"2012","journal-title":"Comput. Educ."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1111\/j.1467-8535.2011.01261.x","article-title":"An empirical study on behavioural intention to reuse e-learning systems in rural China","volume":"43","author":"Li","year":"2012","journal-title":"Br. J. Educ. Technol."},{"key":"ref_65","first-page":"41","article-title":"System-related factors that predict students\u2019 satisfaction with the blackboard learning system at the University of Botswana","volume":"22","author":"Tella","year":"2012","journal-title":"Afr. J. Libr. Arch. Inf. Sci."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Akram, M.S., and Malik, A. (2012, January 2\u20136). Evaluating citizens\u2019 readiness to embrace e-government services. Proceedings of the 2012 ACM Conference on High Integrity Language Technology, Boston, MA, USA.","DOI":"10.1145\/2307729.2307740"},{"key":"ref_67","first-page":"162","article-title":"A hybrid information system model for trust in e-government initiative adoption in public sector organization","volume":"11","author":"Ayyash","year":"2012","journal-title":"Int. J. Bus. Inf. Syst."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"3865","DOI":"10.19026\/rjaset.5.4447","article-title":"Investigating the effect of information systems factors on trust in e-government initiative adoption in palestinian public sector","volume":"5","author":"Ayyash","year":"2013","journal-title":"Res. J. Appl. Sci. Eng. Technol."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"1027","DOI":"10.1080\/0144929X.2014.934291","article-title":"Empirical study on continuance intentions towards E-Learning 2.0 systems","volume":"33","author":"Wu","year":"2014","journal-title":"Behav. Inf. Technol."},{"key":"ref_70","unstructured":"Cauter, L.V., Snoeck, M., and Crompvoets, J. (2014). Lecture Notes in Computer Science, Springer."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"225","DOI":"10.3233\/IP-140341","article-title":"Evaluating e-government systems in Turkey: The case of the \u2018e-movable system","volume":"19","author":"Sebetci","year":"2014","journal-title":"Inf. Polity"},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1016\/j.sbspro.2014.11.148","article-title":"User\u2019s Satisfaction on E-government Services: An Integrated Model","volume":"164","author":"Danila","year":"2014","journal-title":"Procedia-Soc. Behav. Sci."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"33","DOI":"10.19173\/irrodl.v16i4.2084","article-title":"Alteration of influencing factors of e-learning continued intention for different degrees of online participation","volume":"16","author":"Chang","year":"2015","journal-title":"Int. Rev. Res. Open Distance Learn."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1016\/j.ijme.2016.09.002","article-title":"A conceptual model for assessing blog-based learning system success in the context of business education","volume":"14","author":"Wang","year":"2016","journal-title":"Int. J. Manag. Educ."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1108\/LHT-06-2016-0061","article-title":"Chinese students\u2019 behavior intention to use mobile library apps and effects of education level and discipline","volume":"34","author":"Hu","year":"2016","journal-title":"Libr. Hi-Tech."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"1003","DOI":"10.1111\/j.1467-8535.2010.01054.x","article-title":"Modelling the factors that affect individuals zutilization of online learning systems: An empirical study combining the task technology fit model with the theory of planned behaviour","volume":"41","author":"Yu","year":"2010","journal-title":"Br. J. Educ. Technol."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"1421","DOI":"10.1016\/j.tele.2018.03.012","article-title":"The role of transformational leadership as a mediating variable in DeLone and McLean information system success model: The context of online learning usage in Yemen","volume":"35","author":"Aldholay","year":"2018","journal-title":"Telemat. Inform."},{"key":"ref_78","first-page":"52","article-title":"Acceptance and satisfaction of learning management system enabled blended learning based on a modified DeLone-McLean information system success model","volume":"9","author":"Ghazal","year":"2018","journal-title":"Int. J. Inf. Technol. Proj. Manag."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1080\/10494820.2018.1484773","article-title":"Developing and validating a model for assessing paid mobile learning app success","volume":"27","author":"Wang","year":"2019","journal-title":"Interact. Learn. Environ."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.chb.2018.01.029","article-title":"Factors influencing users\u2019 satisfaction and loyalty to digital libraries in Chinese universities","volume":"83","author":"Xu","year":"2018","journal-title":"Comput. Hum. Behav."},{"key":"ref_81","first-page":"163","article-title":"Online learning usage and performance among students within public universities in Yemen","volume":"12","author":"Aldholay","year":"2018","journal-title":"Int. J. Serv. Stand."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"666","DOI":"10.1080\/10447318.2017.1380970","article-title":"Mobile Technology in the Classroom: What Drives Student-Lecturer Interactions?","volume":"34","author":"Gan","year":"2018","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Priskila, R., Setyohadi, D.B., and Santoso, A.J. (2018, January 21\u201322). An investigation of factors affecting the success of regional financial management information system (case study of Palangka Raya Government). Proceedings of the 2018 International Seminar on Research of Information Technology and Intelligent Systems ISRITI, Ypguakarta, Indonesia.","DOI":"10.1109\/ISRITI.2018.8864479"},{"key":"ref_84","doi-asserted-by":"crossref","unstructured":"Fahrianta, R.Y., Chandrarin, G., and Subiyantoro, E. (2018, January 9). The Conceptual Model of Integration of Acceptance and Use of Technology with the Information Systems Success. Proceedings of the 2018 IOP Conference Series: Materials Science and Engineering, Bandung, Indonesian.","DOI":"10.1088\/1757-899X\/407\/1\/012144"},{"key":"ref_85","first-page":"3638","article-title":"A study on senior high school students\u2019 acceptance of mobile learning management system","volume":"97","author":"Mauritsius","year":"2019","journal-title":"J. Theor. Appl. Inf. Technol."},{"key":"ref_86","first-page":"85","article-title":"The determinants and impact of system usage and satisfaction on e-learning success and faculty-student interaction in indonesian private universities","volume":"23","author":"Farida","year":"2019","journal-title":"Malays. J. Consum. Fam. Econ."},{"key":"ref_87","doi-asserted-by":"crossref","unstructured":"Albelali, S.A., and Alaulamie, A.A. (2019, January 1\u20133). Gender Differences in Students\u2019 Continuous Adoption of Mobile Learning in Saudi Higher Education. Proceedings of the 2nd International Conference on Computer Applications & Information Security ICCAIS 2019, Riyadh, Saudi Arabia.","DOI":"10.1109\/CAIS.2019.8769554"},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1177\/0020852319861895","article-title":"A review of the generic end-user adoption of e-government services","volume":"85","author":"Jacob","year":"2019","journal-title":"Int. Rev. Adm. Sci."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"117253","DOI":"10.1109\/ACCESS.2020.3004541","article-title":"Citizen Satisfaction with Mandatory E-Government Services: A Conceptual Framework and an Empirical Validation","volume":"8","author":"Alkraiji","year":"2020","journal-title":"IEEE Access"},{"key":"ref_90","first-page":"36","article-title":"An examination of citizen satisfaction with mandatory e-government services: Comparison of two information systems success models","volume":"15","author":"Alkraiji","year":"2021","journal-title":"Tran. Gov. People Process Policy"},{"key":"ref_91","first-page":"477","article-title":"The study of DeLone-McLean information system success model: The relationship between system quality and information quality","volume":"98","author":"Fitriati","year":"2020","journal-title":"J. Theor. Appl. Inf. Tech."},{"key":"ref_92","first-page":"1314","article-title":"Empirical investigation to explore factors that achieve high quality of mobile learning system based on students\u2019 perspectives","volume":"19","author":"Almaiah","year":"2016","journal-title":"Eng. Sci. Technol. Int. J."},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"227","DOI":"10.2307\/249577","article-title":"Perceived usefulness, ease of use, and usage of information technology: A replication","volume":"16","author":"Adams","year":"1992","journal-title":"MIS Q."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"227","DOI":"10.2307\/249803","article-title":"On the test-retest reliability of perceived usefulness and perceived ease of use scales","volume":"17","author":"Hendrickson","year":"1993","journal-title":"MIS Q."},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/S0378-7206(98)00096-2","article-title":"The Psychological Origins of Perceived Usefulness and Ease of Use","volume":"35","author":"Karahanna","year":"1999","journal-title":"Inf. Manag."},{"key":"ref_96","doi-asserted-by":"crossref","unstructured":"Stefanovic, D., Spasojevic, I., Havzi, S., Lolic, T., and Ristic, S. (2021, January 17\u201319). Information systems success models in the e-learning context: A systematic literature review. Proceedings of the 2021 20th International Symposium INFOTEH-JAHORINA (INFOTEH), East Sarajevo, Bosnia and Herzegovina.","DOI":"10.1109\/INFOTEH51037.2021.9400653"},{"key":"ref_97","doi-asserted-by":"crossref","unstructured":"Ciric, D., Lolic, T., Gracanin, D., Stefanovic, D., and Lalic, B. (2020, January 3\u20136). The Application of ICT Solutions in Manufacturing Companies in Serbia. Proceedings of the IFIP Advances in Information and Communication Technology, Wroclaw, Poland.","DOI":"10.1007\/978-3-030-57997-5_15"},{"key":"ref_98","first-page":"79","article-title":"The core competence of the corporation","volume":"68","author":"Prahalad","year":"1990","journal-title":"Harv. Bus. Rev."},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/S0925-5273(98)00219-9","article-title":"Agile manufacturing: The drivers, concepts and attributes","volume":"62","author":"Yusuf","year":"1999","journal-title":"Int. J. Prod. Econ."},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1002\/(SICI)1520-6564(199724)7:1<3::AID-HFM1>3.0.CO;2-7","article-title":"Human factors in agile manufacturing: A brief overview with emphasis on communication and information infrastructure","volume":"7","author":"Forsythe","year":"1997","journal-title":"Hum. Factors Ergon. Manuf."},{"key":"ref_101","first-page":"99","article-title":"Exploring the link between project management approach","volume":"16","author":"Ciric","year":"2021","journal-title":"Adv. Prod. Eng. Manag."},{"key":"ref_102","unstructured":"Bourdon, S., and Ollet-Haudebert, I. (2009, January 6\u20139). Towards An Understanding of Knowledge Management Systems\u2014UTAUT Revisited. Proceedings of the 15th Americas Conference on Information Systems AMCIS 2009, San Francisco, CA, USA."},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ijinfomgt.2013.06.002","article-title":"Understanding the internet banking adoption: A unified theory of acceptance and use of technology and perceived risk application","volume":"34","author":"Martins","year":"2014","journal-title":"Int. J. Inf. Manag."},{"key":"ref_104","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/j.chb.2017.02.007","article-title":"Explaining the adoption of social networks sites for sharing user-generated content: A revision of the UTAUT2","volume":"71","author":"Herrero","year":"2017","journal-title":"Comput. Hum. Behav."},{"key":"ref_105","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1080\/00049530412331312914","article-title":"Adaptable Behaviours for Successful Work and Career Adjustment","volume":"55","author":"Griffin","year":"2006","journal-title":"Aust. J. Psychol."},{"key":"ref_106","unstructured":"Dawis, R.V. (2005). The Minnesota Theory of Work Adjustment, John Wiley & Sons."},{"key":"ref_107","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1016\/j.ergon.2007.01.007","article-title":"A Review of Enterprise Agility: Concepts, Frameworks, and Attributes","volume":"37","author":"Sherehiy","year":"2007","journal-title":"Int. J. Ind. Ergon."},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"4195","DOI":"10.19026\/rjaset.5.4647","article-title":"A Review on Workforce Agility","volume":"5","author":"Alavi","year":"2013","journal-title":"Res. J. Appl. Sci. Eng. Technol."},{"key":"ref_109","first-page":"299","article-title":"Factors influencing students\u2019 adoption of e-learning: A structural equation modeling approach","volume":"11","author":"Tarhini","year":"2017","journal-title":"J. Int. Educ. Bus."},{"key":"ref_110","first-page":"1","article-title":"An E-Learning Acceptance Evaluation Through Utaut Model in a Postgraduate Program","volume":"16","author":"Mahande","year":"2019","journal-title":"J. Educ. Online"},{"key":"ref_111","first-page":"164","article-title":"Modeling Factors Affecting Student\u2019s Usage Behaviour of E-Learning Systems in Lebanon","volume":"10","author":"Tarhini","year":"2017","journal-title":"Int. J. Bus. Manag."},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/2158244013503837","article-title":"Applying the UTAUT to Understand Factors Affecting the Use of English E-Learning Websites in Taiwan","volume":"3","author":"Tan","year":"2013","journal-title":"SAGE Open"},{"key":"ref_113","first-page":"457","article-title":"Factors influencing the adoption of E-learning in Tabriz University of Medical Sciences","volume":"30","author":"Abdekhoda","year":"2016","journal-title":"Med. J. Islam. Repub. Iran"},{"key":"ref_114","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.compedu.2018.03.016","article-title":"Unfamiliar Technology: Reaction of International Students to Blended Learning","volume":"122","author":"Prasad","year":"2018","journal-title":"Comput. Educ."},{"key":"ref_115","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1108\/ITSE-11-2018-0092","article-title":"University students\u2019 intention to use e-learning systems","volume":"16","author":"Sabraz","year":"2019","journal-title":"Interact. Technol. Smart Educ."},{"key":"ref_116","first-page":"969","article-title":"Understanding Undergraduate Students\u2019 Adoption of Mobile Learning Model: A Perspective of the Extended UTAUT2","volume":"8","author":"Yang","year":"2013","journal-title":"J. Converg. Inf. Technol."},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"1388","DOI":"10.1080\/10494820.2020.1723113","article-title":"Identifying key factors affecting college students\u2019 adoption of the e-learning system in mandatory blended learning environments","volume":"30","author":"Zhang","year":"2020","journal-title":"Interact. Learn. Environ."},{"key":"ref_118","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.ijinfomgt.2017.09.001","article-title":"Improving the agility of employees through enterprise social media: The mediating role of psychological conditions","volume":"38","author":"Cai","year":"2018","journal-title":"Int. J. Inf. Manag."},{"key":"ref_119","first-page":"111","article-title":"The influence of workforce agility on external manufacturing flexibility of Iranian SMEs","volume":"8","author":"Alavi","year":"2017","journal-title":"Int. J. Technol. Learn. Innov. Dev."},{"key":"ref_120","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1016\/j.ergon.2014.01.002","article-title":"The relationship between work organization and workforce agility in small manufacturing enterprises","volume":"44","author":"Sherehiy","year":"2014","journal-title":"Int. J. Ind. Ergon."},{"key":"ref_121","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1111\/j.1467-8535.2007.00809.x","article-title":"Investigating the determinants and age and gender differences in the acceptance of mobile learning","volume":"40","author":"Wang","year":"2009","journal-title":"Br. J. Educ. Technol."},{"key":"ref_122","doi-asserted-by":"crossref","first-page":"614","DOI":"10.1016\/j.chb.2013.07.045","article-title":"Adapting the technology acceptance model to evaluate the innovative potential of e-learning systems","volume":"30","author":"Persico","year":"2014","journal-title":"Comput. Hum. Behav."},{"key":"ref_123","doi-asserted-by":"crossref","first-page":"6273","DOI":"10.1080\/00207543.2014.919420","article-title":"Organic structure and zorganizational learning as the main antecedents of workforce agility","volume":"52","author":"Somaieh","year":"2014","journal-title":"Int. J. Prod. Res."},{"key":"ref_124","unstructured":"Dillman, D.A. (2007). Mail and Internet Surveys: The Tailored Design Method, John Wiley & Sons, Inc.. [2nd ed.]."},{"key":"ref_125","unstructured":"Nunnally, H., and Bernstein, J. (1994). Psihometric Theory, McGraw-Hill."},{"key":"ref_126","unstructured":"Tabachnick, L.S., and Fidell, B.G. (2007). Using Multivariate Statistics, Pearson Education, Inc."},{"key":"ref_127","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1037\/0033-2909.88.3.588","article-title":"Significance tests and goodness of fit in the analysis of covariance structures","volume":"88","author":"Bentler","year":"1980","journal-title":"Psychol. Bull."},{"key":"ref_128","unstructured":"Hair, J.F., Black, W.C., Babin, B.J., and Anderson, R.E. (2009). Multivariate Data Analysis, Prentice Hall. [7th ed.]."},{"key":"ref_129","doi-asserted-by":"crossref","unstructured":"Cordato, D.J., Fatima Shad, K., Soubra, W., and Beran, R.G. (2023). Health Research and Education during and after the COVID-19 Pandemic: An Australian Clinician and Researcher Perspective. Diagnostics, 13.","DOI":"10.3390\/diagnostics13020289"},{"key":"ref_130","doi-asserted-by":"crossref","unstructured":"Sommovigo, V., Bernuzzi, C., Finstad, G.L., Setti, I., Gabanelli, P., Giorgi, G., and Fiabane, E. (2023). How and When May Technostress Impact Workers\u2019 Psycho-Physical Health and Work-Family Interface? A Study during the COVID-19 Pandemic in Italy. Int. J. Environ. Res. Public Health, 20.","DOI":"10.3390\/ijerph20021266"},{"key":"ref_131","doi-asserted-by":"crossref","unstructured":"Kalkanis, K., Kiskira, K., Papageorgas, P., Kaminaris, S.D., Piromalis, D., Banis, G., Mpelesis, D., and Batagiannis, A. (2023). Advanced Manufacturing Design of an Emergency Mechanical Ventilator via 3D Printing\u2014Effective Crisis Response. Sustainability, 15.","DOI":"10.3390\/su15042857"},{"key":"ref_132","doi-asserted-by":"crossref","unstructured":"Zin, K.S.L.T., Kim, S., Kim, H.-S., and Feyissa, I.F. (2023). A Study on Technology Acceptance of Digital Healthcare among Older Korean Adults Using Extended Tam (Extended Technology Acceptance Model). Adm. Sci., 13.","DOI":"10.3390\/admsci13020042"},{"key":"ref_133","doi-asserted-by":"crossref","unstructured":"Marsden, A.R., Zander, K.K., and Lassa, J.A. (2023). Smallholder Farming during COVID-19: A Systematic Review Concerning Impacts, Adaptations, Barriers, Policy, and Planning for Future Pandemics. Land, 12.","DOI":"10.3390\/land12020404"},{"key":"ref_134","doi-asserted-by":"crossref","unstructured":"Chrysafiadi, K., Virvou, M., and Tsihrintzis, G.A. (2023). A Fuzzy-Based Evaluation of E-Learning Acceptance and Effectiveness by Computer Science Students in Greece in the Period of COVID-19. Electronics, 12.","DOI":"10.3390\/electronics12020428"},{"key":"ref_135","doi-asserted-by":"crossref","unstructured":"Garrido-Guti\u00e9rrez, P., S\u00e1nchez-Chaparro, T., and S\u00e1nchez-Naranjo, M.J. (2023). Student Acceptance of E-Learning during the COVID-19 Outbreak at Engineering Universities in Spain. Educ. Sci., 13.","DOI":"10.3390\/educsci13010077"},{"key":"ref_136","doi-asserted-by":"crossref","first-page":"16","DOI":"10.3390\/higheredu2010002","article-title":"Smart Learning Environments during Pandemic","volume":"2","author":"Mutizwa","year":"2023","journal-title":"Trends High. Educ."},{"key":"ref_137","doi-asserted-by":"crossref","unstructured":"Jafar, A., Dollah, R., Mittal, P., Idris, A., Kim, J.E., Abdullah, M.S., Joko, E.P., Tejuddin, D.N.A., Sakke, N., and Zakaria, N.S. (2023). Readiness and Challenges of E-Learning during the COVID-19 Pandemic Era: A Space Analysis in Peninsular Malaysia. Int. J. Environ. Res. Public Health, 20.","DOI":"10.3390\/ijerph20020905"},{"key":"ref_138","doi-asserted-by":"crossref","unstructured":"Oprea, O.M., Bujor, I.E., Cristofor, A.E., Ursache, A., Sandu, B., Lozneanu, L., Mandici, C.E., Szalontay, A.S., Gaina, M.A., and Matasariu, D.-R. (2023). COVID-19 Pandemic Affects Children\u2019s Education but Opens up a New Learning System in a Romanian Rural Area. Children, 10.","DOI":"10.3390\/children10010092"},{"key":"ref_139","doi-asserted-by":"crossref","unstructured":"Alharbi, B.A., Ibrahem, U.M., Moussa, M.A., Abdelwahab, S.M., and Diab, H.M. (2022). COVID-19 the Gateway for Future Learning: The Impact of Online Teaching on the Future Learning Environment. Educ. Sci., 12.","DOI":"10.21203\/rs.3.rs-1703584\/v1"},{"key":"ref_140","doi-asserted-by":"crossref","unstructured":"Anderson, P.J., England, D.E., and Barber, L.D. (2022). Preservice Teacher Perceptions of the Online Teaching and Learning Environment during COVID-19 Lockdown in the UAE. Educ. Sci., 12.","DOI":"10.3390\/educsci12120911"},{"key":"ref_141","doi-asserted-by":"crossref","unstructured":"Shabeeb, M.A., Sobaih, A.E.E., and Elshaer, I.A. (2022). Examining Learning Experience and Satisfaction of Accounting Students in Higher Education before and amid COVID-19. Int. J. Environ. Res. Public Health, 19.","DOI":"10.3390\/ijerph192316164"},{"key":"ref_142","doi-asserted-by":"crossref","unstructured":"Al-Shamali, S., Al-Shamali, A., Alsaber, A., Al-Kandari, A., AlMutairi, S., and Alaya, A. (2022). Impact of Organizational Culture on Academics\u2019 Readiness and Behavioral Intention to Implement eLearning Changes in Kuwaiti Universities during COVID-19. Sustainability, 14.","DOI":"10.3390\/su142315824"},{"key":"ref_143","doi-asserted-by":"crossref","unstructured":"Silva, S., Fernandes, J., Peres, P., Lima, V., and Silva, C. (2022). Teachers\u2019 Perceptions of Remote Learning during the Pandemic: A Case Study. Educ. Sci., 12.","DOI":"10.3390\/educsci12100698"},{"key":"ref_144","doi-asserted-by":"crossref","unstructured":"Antoniadis, K., Zafiropoulos, K., and Mitsiou, D. (2022). Measuring Distance Learning System Adoption in a Greek University during the Pandemic Using the UTAUT Model, Trust in Government, Perceived University Efficiency and Coronavirus Fear. Educ. Sci., 12.","DOI":"10.3390\/educsci12090625"}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/13\/5\/3258\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:47:10Z","timestamp":1760122030000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/13\/5\/3258"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,3]]},"references-count":144,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["app13053258"],"URL":"https:\/\/doi.org\/10.3390\/app13053258","relation":{},"ISSN":["2076-3417"],"issn-type":[{"value":"2076-3417","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,3]]}}}