{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T22:42:07Z","timestamp":1769553727057,"version":"3.49.0"},"reference-count":29,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2022,10,11]],"date-time":"2022-10-11T00:00:00Z","timestamp":1665446400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["K"],"published-print":{"date-parts":[[2024,1,2]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>Usage of learning management systems (LMSs) has become widespread with the disruption of face-to-face educations after the COVID-19 pandemic. There are several software products, usually named as LMS to enable and support distance education. However, selection of a suitable LMS is a complex multiple criteria decision making (MCDM) problem that requires consideration of many criteria and inputs from different parties like students, academicians, education managers, etc. Usability evaluation of LMS is one of the critical steps in deciding which LMS system to be adapted. There are several studies related to usability evaluation of LMS in the literature, but utilization of MCDM methods and real life case studies are very rare. Based on this motivation, perceived usability evaluation of SAKAI-LMS that is in use at an academic department is performed by employing axiomatic design procedure (ADP). This paper aims to discuss the aforementioned issues.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>ADP is considered as a suitable MCDM method for perceived usability evaluation as it allows an easy approach to data fusion and setting performance targets for decision makers. A\u00a0questionnaire is developed to collect data from three types of system users about predetermined usability criteria and their importance. After detailed statistical analyses and weighting criteria via analytical hierarch process (AHP), ADP is carried out to evaluate usability of the LMS.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>It is found that the proposed ADP based approach is easy to apply in practical circumstances and able to quantify perceived usability of the LMSs.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Research limitations\/implications<\/jats:title><jats:p>The proposed approach provides an easy and practical evaluation of perceived usability of the LMSs for decision makers who are responsible for the implementation of LMSs. The\u00a0developed novel and practical MCDM-based perceived usability approach for LMS in this study has been verified through a real life case study at an academic department. Perceived usability results, therefore, reflects only the views of this focus group and are not generalizable.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>First time in the literature, a comprehensive ADP based MCDM approach is proposed based on the analyses of the related literature and information gathered from the system users.<\/jats:p><\/jats:sec>","DOI":"10.1108\/k-07-2022-1024","type":"journal-article","created":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T23:05:47Z","timestamp":1665443147000},"page":"83-101","source":"Crossref","is-referenced-by-count":8,"title":["Perceived usability evaluation of\u00a0learning management systems via axiomatic design with a real life application"],"prefix":"10.1108","volume":"53","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4952-7239","authenticated-orcid":false,"given":"Adil","family":"Baykasoglu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Burcu","family":"Felekoglu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ceylin","family":"\u00dcnal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","published-online":{"date-parts":[[2022,10,11]]},"reference":[{"issue":"1","key":"key2023122105454671300_ref001","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1080\/01587919.2018.1553562","article-title":"Predicting student satisfaction and perceived learning within online learning environments","volume":"40","year":"2019","journal-title":"Distance Education"},{"issue":"2","key":"key2023122105454671300_ref002","first-page":"14","article-title":"A learning management system developed at the eastern Mediterranean university","volume":"2","year":"2003","journal-title":"The Turkish Online Journal of Educational Technology"},{"key":"key2023122105454671300_ref003","article-title":"Towards a unified criteria model for usability evaluation in the context of open source software based on a fuzzy Delphi method","volume":"130","year":"2021","journal-title":"Information and Software Technology"},{"issue":"3","key":"key2023122105454671300_ref004","first-page":"429","article-title":"Integrated model for software usability","volume":"4","year":"2012","journal-title":"International Journal on Computer Science and Engineering"},{"issue":"3","key":"key2023122105454671300_ref005","first-page":"404","article-title":"Usability evaluation of software systems using fuzzy multi-criteria approach","volume":"9","year":"2012","journal-title":"International Journal of Computer Science Issues"},{"issue":"3","key":"key2023122105454671300_ref006","first-page":"32","article-title":"Innovative use of Blackboard\u00ae to assess laboratory skills","volume":"3","year":"2010","journal-title":"Journal of Learning Design"},{"issue":"3","key":"key2023122105454671300_ref007","first-page":"990","article-title":"Critical analysis on usability evaluation techniques","volume":"4","year":"2012","journal-title":"International Journal of Engineering Science and Technology"},{"key":"key2023122105454671300_ref008","unstructured":"ISO 9241-11:2018 \u201cInternational organization for standardization: ergonomics of human-system interaction-Part 11: usability: definitions and concepts\u201d, available at: https:\/\/www.iso.org\/standard\/63500.html"},{"key":"key2023122105454671300_ref009","unstructured":"ISO\/IEC 25010:2011 \u201cInternational organization for standardization: systems and software engineering - systems and software quality requirements and evaluation (SQuaRE) - system and software quality models\u201d, available at: https:\/\/www.iso.org\/standard\/35733.html"},{"key":"key2023122105454671300_ref010","first-page":"613","article-title":"Evaluating usability in learning management system Moodle","year":"2008"},{"issue":"3","key":"key2023122105454671300_ref011","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1016\/j.ijpe.2004.02.009","article-title":"Multi-attribute comparison of advanced manufacturing systems using fuzzy vs crisp axiomatic design approach","volume":"95","year":"2005","journal-title":"International Journal of Production Economics"},{"key":"key2023122105454671300_ref012","volume-title":"Sampling of Populations: Methods and Applications","year":"2008","edition":"4th ed."},{"issue":"1","key":"key2023122105454671300_ref013","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1080\/10447319509526110","article-title":"IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use","volume":"7","year":"1995","journal-title":"International Journal of Human-Computer Interaction"},{"issue":"12","key":"key2023122105454671300_ref014","doi-asserted-by":"crossref","first-page":"1148","DOI":"10.1080\/10447318.2017.1418805","article-title":"Measuring perceived usability: the CSUQ, SUS, and UMUX","volume":"34","year":"2018","journal-title":"International Journal of Human-Computer Interaction"},{"key":"key2023122105454671300_ref015","first-page":"12","article-title":"Usability in e-Learning Platforms: heuristics comparison between Moodle, Sakai and dotLRN","year":"2008"},{"key":"key2023122105454671300_ref016","volume-title":"Usability Engineering","year":"1993"},{"issue":"2","key":"key2023122105454671300_ref017","first-page":"73","article-title":"Usability evaluation of learning management system in a higher education institution: a scale development study","volume":"10","year":"2016","journal-title":"Journal of Global Strategic Management"},{"key":"key2023122105454671300_ref018","article-title":"Perceived usability evaluation of Microsoft Teams as an online learning platform during COVID-19 using system usability scale and technology acceptance model in India","volume":"119","year":"2020","journal-title":"Children and Youth Services Review"},{"key":"key2023122105454671300_ref019","volume-title":"Models, Methods, Concepts & Applications of the Analytic Hierarchy Process","year":"2012"},{"key":"key2023122105454671300_ref020","doi-asserted-by":"publisher","DOI":"10.1007\/s41870-017-0048-1","article-title":"A systematic review of software usability studies","year":"2017","journal-title":"International Journal of Information Technology"},{"issue":"4","key":"key2023122105454671300_ref021","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1016\/j.knosys.2009.01.002","article-title":"Augmented fuzzy cognitive maps for modelling LMS critical success factors","volume":"22","year":"2009","journal-title":"Knowledge-based Systems"},{"issue":"2","key":"key2023122105454671300_ref022","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/s11219-006-7600-8","article-title":"Usability measurement and metrics: a consolidated model","volume":"14","year":"2006","journal-title":"Software Quality Journal"},{"key":"key2023122105454671300_ref023","first-page":"850","article-title":"Usability evaluation of a Moodle based learning management system","year":"2014"},{"issue":"5-6","key":"key2023122105454671300_ref024","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1016\/j.intcom.2009.04.007","article-title":"Usability-context, framework, definition, design and evaluation","volume":"21","year":"2009","journal-title":"Interacting with Computers"},{"issue":"347","key":"key2023122105454671300_ref025","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1080\/01621459.1974.10480196","article-title":"EDF statistics for goodness of fit and some comparisons","volume":"69","year":"1974","journal-title":"Journal of the American Statistical Association"},{"key":"key2023122105454671300_ref026","doi-asserted-by":"crossref","unstructured":"Subulan, K. and Baykasoglu, A. (2021), \u201cAn improved extension of weighted hierarchical fuzzy axiomatic design: sustainable route selection problem in intermodal transportation networks\u201d, in, Sustainable Production and Logistics, CRC Press, pp.\u00a0321-357.","DOI":"10.1201\/9781003005018-16-17"},{"key":"key2023122105454671300_ref027","volume-title":"Axiomatic Design - Advances and Applications","year":"2001"},{"issue":"1","key":"key2023122105454671300_ref028","first-page":"15","article-title":"Usability evaluation of learning management systems in Sri Lankan universities","volume":"15","year":"2015","journal-title":"Global Journal of Computer Science and Technology: C Software and Data Engineering"},{"key":"key2023122105454671300_ref029","unstructured":"XLSTAT: Tutorials and Guides (2022), \u201cHow to interpret contradictory results between ANOVA and multiple pairwise comparisons?\u201d, available at: https:\/\/help.xlstat.com\/tutorial-guides\/modeling-data\/anova (accessed 27 April 2022)."}],"container-title":["Kybernetes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/K-07-2022-1024\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/K-07-2022-1024\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T21:49:29Z","timestamp":1753393769000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/k\/article\/53\/1\/83-101\/1236019"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,11]]},"references-count":29,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,10,11]]},"published-print":{"date-parts":[[2024,1,2]]}},"alternative-id":["10.1108\/K-07-2022-1024"],"URL":"https:\/\/doi.org\/10.1108\/k-07-2022-1024","relation":{},"ISSN":["0368-492X"],"issn-type":[{"value":"0368-492X","type":"print"}],"subject":[],"published":{"date-parts":[[2022,10,11]]}}}