{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,8]],"date-time":"2026-06-08T12:06:22Z","timestamp":1780920382594,"version":"3.54.1"},"reference-count":163,"publisher":"World Scientific Pub Co Pte Ltd","issue":"01","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Info. Tech. Dec. Mak."],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:p> Increasing demand for open-source software (OSS) has raised the value of efficient selection in terms of quality; usability is an essential quality factor that significantly affects system acceptability and sustainability. Most large and complex software packages partitioned across multiple portals and involve many users \u2014 each with their role in the software package; those users have different perspectives on the software package, defined by their knowledge, responsibilities, and commitments. Thus, a multi-perspective approach has been used in usability evaluation to overcome the challenge of inconsistency between users\u2019 perspectives; the inconsistency challenge would lead to an ill-advised decision on the selection of a suitable OSS. This study aimed to assist the public and private organizations in evaluating and selecting the most suitable OSS. The evaluation of the OSS software packages to choose the best one is a challenging task owing to (a) multiple evaluation criteria, (b) criteria importance, and (c) data variation; thus, it is considered a sophisticated multi-criteria decision making (MCDM) problem; moreover, the multi-perspective usability evaluation framework for OSS selection lacks in the current literature. Hence, this study proposes a novel multi-perspective usability evaluation framework for the selection of OSS based on the multi-criteria analysis. Integration of best-worst method (BWM) and VIKOR MCDM techniques has been used for weighting and ranking OSS alternatives. BWM is utilized for weighting of evaluation criteria, whereas VIKOR is applied to rank OSS-LMS alternatives. Individual and group decision-making contexts, and the internal and external groups aggregation were used to demonstrate the efficiency of the proposed framework. A well-organized algorithmic procedure is presented in detail, and a case study was examined to illustrate the validity and feasibility of the proposed framework. The results demonstrated that BWM and VIKOR integration works effectively to solve the OSS software package benchmarking\/selection problems. Furthermore, the ranks of OSS software packages obtained from the VIKOR internal and external group decision making were similar; the best OSS-LMS based on the two ways was \u2018Moodle\u2019 software package. Among the scores of groups in the objective validation, significant differences were identified; this indicated that the ranking results of internal and external VIKOR group decision making were valid, which pointed to the validation of the framework. <\/jats:p>","DOI":"10.1142\/s0219622021500139","type":"journal-article","created":{"date-parts":[[2021,3,26]],"date-time":"2021-03-26T04:21:19Z","timestamp":1616732479000},"page":"187-277","source":"Crossref","is-referenced-by-count":16,"title":["Novel Multi-Perspective Usability Evaluation Framework for Selection of Open Source Software Based on BWM and Group VIKOR Techniques"],"prefix":"10.1142","volume":"22","author":[{"given":"Kareem A.","family":"Dawood","sequence":"first","affiliation":[{"name":"Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"A. A.","family":"Zaidan","sequence":"additional","affiliation":[{"name":"Department of Computing, FSKIK, Universiti Pendidikan Sultan Idris, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Khaironi Y.","family":"Sharif","sequence":"additional","affiliation":[{"name":"Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abdul A.","family":"Ghani","sequence":"additional","affiliation":[{"name":"Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"H.","family":"Zulzalil","sequence":"additional","affiliation":[{"name":"Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"B. B.","family":"Zaidan","sequence":"additional","affiliation":[{"name":"Department of Computing, FSKIK, Universiti Pendidikan Sultan Idris, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"219","published-online":{"date-parts":[[2021,3,22]]},"reference":[{"key":"S0219622021500139BIB001","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1109\/SITIS.2008.106","volume-title":"2008 IEEE International Conference on Signal Image Technology and Internet Based Systems","author":"\u00c7etin G.","year":"2008"},{"issue":"4","key":"S0219622021500139BIB002","doi-asserted-by":"crossref","first-page":"1109","DOI":"10.1016\/j.chb.2012.01.018","volume":"28","author":"Raza A.","year":"2012","journal-title":"Computers in Human Behavior"},{"key":"S0219622021500139BIB003","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.advengsoft.2013.12.001","volume":"69","author":"Sarrab M.","year":"2014","journal-title":"Advances in Engineering Software"},{"issue":"2","key":"S0219622021500139BIB004","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.hitech.2017.10.008","volume":"28","author":"Joia L. A.","year":"2017","journal-title":"Journal of High Technology Management Research"},{"key":"S0219622021500139BIB005","volume-title":"25th Australasian Conf. Information Systems","author":"Netta Iivari M. R. H. H."},{"key":"S0219622021500139BIB006","first-page":"264","volume-title":"IFIP Int. Federation for Information Processing","author":"Paul C. L.","year":"2009"},{"key":"S0219622021500139BIB007","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.infsof.2018.07.009","volume":"104","author":"Sbai N.","year":"2018","journal-title":"Information and Software Technology"},{"issue":"6","key":"S0219622021500139BIB008","doi-asserted-by":"crossref","first-page":"83","DOI":"10.11648\/j.ajsea.20140306.13","volume":"3","author":"Yah Jusoh Y.","year":"2014","journal-title":"American Journal of Software Engineering and Applications"},{"key":"S0219622021500139BIB009","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1007\/978-3-540-73257-0_50","volume":"4564","author":"Nikos Viorres P. X.","year":"2007","journal-title":"Online Communities and Social Computing"},{"key":"S0219622021500139BIB010","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.infsof.2018.10.011","volume":"107","author":"Llerena L.","year":"2019","journal-title":"Information and Software Technology"},{"key":"S0219622021500139BIB011","doi-asserted-by":"crossref","first-page":"65913","DOI":"10.1109\/ACCESS.2019.2914368","volume":"7","author":"Dawood K. A.","year":"2019","journal-title":"IEEE Access"},{"key":"S0219622021500139BIB012","doi-asserted-by":"crossref","first-page":"105151","DOI":"10.1016\/j.cmpb.2019.105151","volume":"185","author":"Mohammed K.","year":"2019","journal-title":"Computer Methods and Programs in Biomedicine"},{"key":"S0219622021500139BIB013","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2015.07.002"},{"key":"S0219622021500139BIB014","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2682"},{"issue":"21","key":"S0219622021500139BIB015","doi-asserted-by":"crossref","first-page":"278","DOI":"10.4156\/ijact.vol4.issue21.33","volume":"4","author":"Jusoh Y. Y.","year":"2012","journal-title":"International Journal of Advancements in Computing Technology"},{"issue":"4","key":"S0219622021500139BIB016","doi-asserted-by":"crossref","first-page":"51","DOI":"10.4156\/ijipm.vol4.issue4.6","volume":"4","author":"Sarrab M.","year":"2013","journal-title":"International Journal of Information Processing and Management"},{"key":"S0219622021500139BIB017","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.advengsoft.2013.12.001","volume":"69","author":"Sarrab M. R.","year":"2014","journal-title":"Advances in Engineering Software"},{"key":"S0219622021500139BIB018","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1145\/336512.336588","volume-title":"Proc. Conf. Future of Software Engineering","author":"Fenton N. E.","year":"2000"},{"key":"S0219622021500139BIB019","volume-title":"Proc. 9th QAOOSE Workshop (ECOOP)","author":"Khosravi K.","year":"2005"},{"issue":"4","key":"S0219622021500139BIB020","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/s11219-007-9029-0","volume":"15","author":"C\u00f4t\u00e9 M.-A. S.","year":"2007","journal-title":"Software Quality Journal"},{"key":"S0219622021500139BIB021","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/FLOSS.2007.2","volume-title":"First Int. Workshop on Emerging Trends in FLOSS Research and Development (FLOSS\u201907: ICSE Workshops 2007)","author":"Henrik Hedberg N. I.","year":"2007"},{"key":"S0219622021500139BIB022","volume-title":"Presented at the Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design","author":"Rajanen M.","year":"2012"},{"key":"S0219622021500139BIB023","first-page":"1","volume-title":"European Conf. Information Systems (ECIS)","author":"Rajanen M.","year":"2010"},{"key":"S0219622021500139BIB024","first-page":"1466","volume-title":"European Conf. Information Systems (ECIS)","author":"Iivari N.","year":"2008"},{"issue":"10","key":"S0219622021500139BIB025","first-page":"1018","volume":"10","author":"Al-Rawashdeh T. A.","year":"2015","journal-title":"International Review on Computers and Software"},{"key":"S0219622021500139BIB026","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/978-3-319-69989-9_11","volume-title":"Complex Systems: Solutions and Challenges in Economics, Management and Engineering","author":"Fern\u00e1ndez-P\u00e9rez Y.","year":"2018"},{"key":"S0219622021500139BIB027","doi-asserted-by":"crossref","first-page":"65913","DOI":"10.1109\/ACCESS.2019.2914368","volume":"7","author":"Dawood K. A.","year":"2019","journal-title":"IEEE Access"},{"key":"S0219622021500139BIB029","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.07.236"},{"issue":"1","key":"S0219622021500139BIB030","doi-asserted-by":"crossref","first-page":"98","DOI":"10.18517\/ijaseit.10.1.10225","volume":"10","author":"Yusop N. S. M.","year":"2020","journal-title":"International Journal on Advanced Science, Engineering and Information Technology"},{"key":"S0219622021500139BIB031","volume-title":"Open Source Software in Business: Issues and Perspectives","author":"Nichols D. M.","year":"2006"},{"issue":"2","key":"S0219622021500139BIB032","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/s00366-011-0222-1","volume":"28","author":"Raza A.","year":"2011","journal-title":"Engineering with Computers"},{"issue":"3","key":"S0219622021500139BIB033","first-page":"1","volume":"17","author":"Raza A.","year":"2012","journal-title":"First Monday: Peer-Reviewed Open Journal on the Internet"},{"key":"S0219622021500139BIB034","volume-title":"Presented at the Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems","author":"Masson A. L.","year":"2017"},{"key":"S0219622021500139BIB035","first-page":"1","volume-title":"Technology Management for Global Economic Growth (PICMET), 2010 Proc. PICMET\u201910","author":"Sethanandha B. D.","year":"2010"},{"issue":"8","key":"S0219622021500139BIB036","doi-asserted-by":"crossref","first-page":"653","DOI":"10.1002\/smr.455","volume":"22","author":"Luyin Zhao F. P. D.","year":"2010","journal-title":"Journal of Software Maintenance and Evolution: Research and Practice"},{"key":"S0219622021500139BIB037","first-page":"43","volume-title":"Proc. Int. workshop on Utility, Usability and Complexity of e-Information systems","author":"Wesson J.","year":"2003"},{"key":"S0219622021500139BIB039","volume-title":"Proc. SACLA 2010 Conference","author":"Padayachee I.","year":"2010"},{"key":"S0219622021500139BIB040","doi-asserted-by":"crossref","first-page":"568","DOI":"10.1109\/ALPIT.2007.83","volume-title":"Sixth International Conference on Advanced Language Processing and Web Information Technology (ALPIT 2007)","author":"Lee Y. M.","year":"2007"},{"key":"S0219622021500139BIB041","doi-asserted-by":"publisher","DOI":"10.1186\/s40064-016-1828-y"},{"issue":"2","key":"S0219622021500139BIB042","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1080\/07370024.2017.1298038","volume":"33","author":"Tractinsky N.","year":"2018","journal-title":"Human\u2013Computer Interaction"},{"key":"S0219622021500139BIB043","doi-asserted-by":"crossref","first-page":"105151","DOI":"10.1016\/j.cmpb.2019.105151","volume":"185","author":"Mohammed K.","year":"2019","journal-title":"Computer Methods and Programs in Biomedicine"},{"key":"S0219622021500139BIB044","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2014.11.012"},{"key":"S0219622021500139BIB045","volume-title":"IEEE Transactions on Engineering Management","author":"Kannan A. K.","year":"2019"},{"key":"S0219622021500139BIB046","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-08-052029-2.50007-3"},{"issue":"21","key":"S0219622021500139BIB047","doi-asserted-by":"crossref","first-page":"278","DOI":"10.4156\/ijact.vol4.issue21.33","volume":"4","author":"Jusoh Y.","year":"2012","journal-title":"International Journal of Advancements in Computing Technology"},{"key":"S0219622021500139BIB048","doi-asserted-by":"publisher","DOI":"10.11648\/j.ajsea.20140306.13"},{"key":"S0219622021500139BIB049","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2014.07.002"},{"key":"S0219622021500139BIB050","doi-asserted-by":"publisher","DOI":"10.1186\/s40064-016-1828-y"},{"key":"S0219622021500139BIB052","volume-title":"GIS and Multicriteria Decision Analysis","author":"Malczewski J.","year":"1999"},{"key":"S0219622021500139BIB053","doi-asserted-by":"publisher","DOI":"10.1201\/b11032"},{"key":"S0219622021500139BIB054","doi-asserted-by":"publisher","DOI":"10.1142\/S0218001417590029"},{"key":"S0219622021500139BIB055","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2013.10.019"},{"key":"S0219622021500139BIB056","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2013.11.035"},{"key":"S0219622021500139BIB057","doi-asserted-by":"publisher","DOI":"10.1287\/inte.9.4.94"},{"key":"S0219622021500139BIB058","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2465"},{"key":"S0219622021500139BIB059","doi-asserted-by":"publisher","DOI":"10.1142\/S021812661750116X"},{"key":"S0219622021500139BIB060","doi-asserted-by":"publisher","DOI":"10.1109\/CoDIT.2017.8102743"},{"key":"S0219622021500139BIB061","doi-asserted-by":"publisher","DOI":"10.1016\/j.measurement.2017.09.027"},{"key":"S0219622021500139BIB062","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-05020-4"},{"key":"S0219622021500139BIB063","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2994746"},{"key":"S0219622021500139BIB064","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-018-0983-9"},{"issue":"1","key":"S0219622021500139BIB065","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1007\/s10916-018-1006-6","volume":"42","author":"Albahri O.","year":"2018","journal-title":"Journal of Medical Systems"},{"key":"S0219622021500139BIB066","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2881282"},{"key":"S0219622021500139BIB067","doi-asserted-by":"publisher","DOI":"10.1007\/s11235-019-00575-7"},{"key":"S0219622021500139BIB068","doi-asserted-by":"publisher","DOI":"10.1007\/s12553-019-00357-w"},{"key":"S0219622021500139BIB069","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2018.12.019"},{"key":"S0219622021500139BIB070","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2910411"},{"key":"S0219622021500139BIB071","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622019300039"},{"key":"S0219622021500139BIB072","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04325-3"},{"key":"S0219622021500139BIB074","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-019-1336-z"},{"key":"S0219622021500139BIB075","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2936898"},{"key":"S0219622021500139BIB076","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-018-0943-4"},{"key":"S0219622021500139BIB077","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1142\/S0219622020500121","volume":"19","author":"Zaidan A.","year":"2020","journal-title":"International Journal of Information Technology & Decision Making"},{"key":"S0219622021500139BIB078","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139174084","volume-title":"Decisions with Multiple Objectives: Preferences and Value Trade-offs.","author":"Keeney R. L.","year":"1993"},{"key":"S0219622021500139BIB079","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622019300039"},{"key":"S0219622021500139BIB080","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2465"},{"key":"S0219622021500139BIB081","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-1495-4"},{"key":"S0219622021500139BIB082","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622017500183"},{"key":"S0219622021500139BIB083","doi-asserted-by":"publisher","DOI":"10.1007\/s11235-017-0401-5"},{"key":"S0219622021500139BIB084","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-019-1338-x"},{"key":"S0219622021500139BIB085","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-019-1362-x"},{"key":"S0219622021500139BIB086","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-018-1064-9"},{"key":"S0219622021500139BIB087","doi-asserted-by":"publisher","DOI":"10.1016\/j.measurement.2017.12.019"},{"key":"S0219622021500139BIB088","doi-asserted-by":"publisher","DOI":"10.1007\/s12553-018-0223-9"},{"key":"S0219622021500139BIB089","doi-asserted-by":"publisher","DOI":"10.1287\/inte.9.4.94"},{"key":"S0219622021500139BIB090","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2020.105617"},{"key":"S0219622021500139BIB092","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2015.12.003"},{"key":"S0219622021500139BIB093","first-page":"1","volume":"93","author":"Abdulkareem K. H.","year":"2020","journal-title":"International Journal of Information Technology & Decision Making"},{"key":"S0219622021500139BIB094","doi-asserted-by":"publisher","DOI":"10.1016\/j.jiph.2020.06.028"},{"key":"S0219622021500139BIB096","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-018-3808-3"},{"key":"S0219622021500139BIB098","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2018.12.019"},{"key":"S0219622021500139BIB099","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-017-0883-4"},{"key":"S0219622021500139BIB100","doi-asserted-by":"publisher","DOI":"10.1016\/j.measurement.2018.01.011"},{"key":"S0219622021500139BIB101","first-page":"10","volume":"2014","author":"Whaiduzzaman M.","year":"2014","journal-title":"The Scientific World Journal"},{"key":"S0219622021500139BIB102","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2020.106595"},{"key":"S0219622021500139BIB103","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622020300049"},{"key":"S0219622021500139BIB104","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1142\/S0219622020500285","volume":"19","author":"Albahri A.","year":"2020","journal-title":"International Journal of Information Technology & Decision Making"},{"key":"S0219622021500139BIB105","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622017500225"},{"issue":"1","key":"S0219622021500139BIB106","first-page":"31","volume":"1","author":"Aruldoss M.","year":"2013","journal-title":"American Journal of Information Systems"},{"key":"S0219622021500139BIB107","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(03)00020-1"},{"key":"S0219622021500139BIB108","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2017.01.010"},{"key":"S0219622021500139BIB109","doi-asserted-by":"publisher","DOI":"10.3390\/f7050100"},{"key":"S0219622021500139BIB110","doi-asserted-by":"publisher","DOI":"10.1111\/hex.12287"},{"key":"S0219622021500139BIB111","first-page":"1","author":"Lin C.","year":"2020","journal-title":"Annals of Operations Research"},{"key":"S0219622021500139BIB112","doi-asserted-by":"publisher","DOI":"10.9790\/3021-04521525"},{"key":"S0219622021500139BIB113","doi-asserted-by":"publisher","DOI":"10.1016\/j.omega.2014.11.009"},{"key":"S0219622021500139BIB114","first-page":"22","volume-title":"2007 IEEE Symp. Computational Intelligence in Multi-Criteria Decision-Making","author":"Kornyshova E.","year":"2007"},{"key":"S0219622021500139BIB115","doi-asserted-by":"publisher","DOI":"10.1002\/er.4016"},{"key":"S0219622021500139BIB116","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclepro.2017.03.166"},{"key":"S0219622021500139BIB117","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclepro.2017.03.125"},{"key":"S0219622021500139BIB118","doi-asserted-by":"publisher","DOI":"10.1016\/j.omega.2015.12.001"},{"key":"S0219622021500139BIB119","doi-asserted-by":"publisher","DOI":"10.3390\/sym8110137"},{"key":"S0219622021500139BIB120","doi-asserted-by":"publisher","DOI":"10.1002\/er.4050"},{"key":"S0219622021500139BIB121","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(03)00020-1"},{"key":"S0219622021500139BIB122","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2016.04.040"},{"key":"S0219622021500139BIB123","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2011.09.012"},{"key":"S0219622021500139BIB124","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2012.06.017"},{"key":"S0219622021500139BIB125","doi-asserted-by":"publisher","DOI":"10.1016\/j.matdes.2010.10.015"},{"key":"S0219622021500139BIB126","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2006.01.020"},{"issue":"8","key":"S0219622021500139BIB127","doi-asserted-by":"crossref","first-page":"1449","DOI":"10.4314\/jasem.v23i8.7","volume":"23","author":"Odu G.","year":"2019","journal-title":"Journal of Applied Sciences Environmental Management"},{"key":"S0219622021500139BIB128","doi-asserted-by":"publisher","DOI":"10.3390\/sym10060205"},{"key":"S0219622021500139BIB129","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2020.106453"},{"issue":"12","key":"S0219622021500139BIB130","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1109\/32.106986","volume":"17","author":"Leite J. C. S. D. P.","year":"1991","journal-title":"IEEE Transactions on Software Engineering"},{"key":"S0219622021500139BIB131","volume-title":"Usability Engineering","author":"Nielsen J.","year":"1994"},{"issue":"1","key":"S0219622021500139BIB132","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1186\/s40064-016-1828-y","volume":"5","author":"Elias N. F.","year":"2016","journal-title":"SpringerPlus"},{"key":"S0219622021500139BIB133","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1016\/j.sbspro.2012.11.346","volume":"67","author":"Awang N. B.","year":"2012","journal-title":"Procedia - Social and Behavioral Sciences"},{"issue":"6","key":"S0219622021500139BIB134","doi-asserted-by":"crossref","first-page":"400","DOI":"10.14569\/IJACSA.2020.0110652","volume":"11","author":"Basaran S.","year":"2020","journal-title":"International Journal of Advanced Computer Science and Applications"},{"key":"S0219622021500139BIB135","volume-title":"Marketing Research: Methodological Foundations.","author":"Churchill G. A.","year":"2006"},{"issue":"3","key":"S0219622021500139BIB136","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1108\/EL-03-2017-0049","volume":"36","author":"Khatun A.","year":"2018","journal-title":"The Electronic Library"},{"key":"S0219622021500139BIB137","first-page":"206","volume-title":"Proc. INTERACT\u201993 and CHI\u201993 Conf. Human Factors in Computing Systems","author":"Nielsen J.","year":"1993"},{"key":"S0219622021500139BIB138","volume-title":"Handbook of Usability Testing: How to Plan, Design and Conduct Effective Tests","author":"Rubin J.","year":"2008"},{"key":"S0219622021500139BIB139","volume-title":"A Practical Guide to Usability Testing","author":"Dumas J. S.","year":"1999"},{"issue":"1","key":"S0219622021500139BIB140","first-page":"25","volume":"3","author":"Yaghmaie F.","year":"2003","journal-title":"Journal of Medical Education"},{"issue":"5","key":"S0219622021500139BIB141","first-page":"367","volume":"8","author":"Lam K. W.","year":"2018","journal-title":"International Journal of Academic Research in Business and Social Sciences"},{"issue":"1","key":"S0219622021500139BIB142","doi-asserted-by":"crossref","first-page":"2","DOI":"10.5539\/gjhs.v1n1p2","volume":"1","author":"Parsian N.","year":"2009","journal-title":"Global Journal of Health Science"},{"issue":"2","key":"S0219622021500139BIB143","doi-asserted-by":"crossref","first-page":"165","DOI":"10.15171\/jcs.2015.017","volume":"4","author":"Zamanzadeh V.","year":"2015","journal-title":"Journal of Caring Sciences"},{"issue":"2","key":"S0219622021500139BIB144","first-page":"152","volume":"37","author":"Shi J.","year":"2012","journal-title":"Zhong nan da xue xue bao. Yi xue ban Journal of Central South University. Medical Sciences"},{"issue":"4","key":"S0219622021500139BIB145","first-page":"526","volume":"21","author":"Charfi S.","year":"2015","journal-title":"Journal of Universal Computer Science"},{"key":"S0219622021500139BIB146","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2014.930311"},{"key":"S0219622021500139BIB147","first-page":"1","volume-title":"2009 Int. Conf. Current Trends in Information Technology (CTIT)","author":"Al-Wabil A.","year":"2009"},{"key":"S0219622021500139BIB148","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5121\/ijsea.2017.8101","volume":"8","author":"Abdalla A.","year":"2017","journal-title":"International Journal of Software Engineering & Applications"},{"key":"S0219622021500139BIB149","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1145\/1518701.1518803","volume-title":"Proc. SIGCHI Conf. Human Factors in Computing Systems","author":"Grossman T.","year":"2009"},{"key":"S0219622021500139BIB150","volume-title":"Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics","author":"Albert W.","year":"2013"},{"key":"S0219622021500139BIB151","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-006-7600-8"},{"issue":"1","key":"S0219622021500139BIB152","first-page":"71","volume":"41","author":"Mohd W. R. W.","year":"2017","journal-title":"Informatica"},{"key":"S0219622021500139BIB153","doi-asserted-by":"publisher","DOI":"10.1016\/j.measurement.2017.07.024"},{"key":"S0219622021500139BIB154","first-page":"1","author":"Enaizan O.","year":"2018","journal-title":"Health and Technology"},{"key":"S0219622021500139BIB155","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2018.04.015"},{"key":"S0219622021500139BIB156","doi-asserted-by":"publisher","DOI":"10.3390\/sym8110137"},{"key":"S0219622021500139BIB157","doi-asserted-by":"publisher","DOI":"10.1016\/j.omega.2015.12.001"},{"key":"S0219622021500139BIB158","doi-asserted-by":"publisher","DOI":"10.1016\/j.omega.2014.11.009"},{"key":"S0219622021500139BIB159","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2020.05.047"},{"key":"S0219622021500139BIB160","volume-title":"Doctoral Dissertation","author":"Detyniecki M.","year":"2000"},{"key":"S0219622021500139BIB161","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-018-0916-7"},{"issue":"1","key":"S0219622021500139BIB162","doi-asserted-by":"crossref","first-page":"20","DOI":"10.14528\/snr.2016.50.1.69","volume":"50","author":"Vrbnjak D.","year":"2016","journal-title":"Obzornik zdravstvene nege"},{"key":"S0219622021500139BIB163","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2941640"},{"key":"S0219622021500139BIB164","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-018-0916-7"},{"key":"S0219622021500139BIB165","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-019-1338-x"},{"key":"S0219622021500139BIB166","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-019-1339-9"},{"key":"S0219622021500139BIB167","author":"Khatari M.","year":"2020","journal-title":"International Journal of Information Technology & Decision Making"},{"key":"S0219622021500139BIB168","author":"Zughoul O.","year":"2020","journal-title":"International Journal of Information Technology & Decision Making"},{"issue":"2","key":"S0219622021500139BIB169","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1002\/int.22322","volume":"36","author":"Albahri O. S.","year":"2020","journal-title":"International Journal of Intelligent Systems"},{"key":"S0219622021500139BIB170","doi-asserted-by":"publisher","DOI":"10.1007\/s10479-016-2208-2"}],"container-title":["International Journal of Information Technology &amp; Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0219622021500139","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T05:26:27Z","timestamp":1675401987000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0219622021500139"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,22]]},"references-count":163,"journal-issue":{"issue":"01","published-print":{"date-parts":[[2023,1]]}},"alternative-id":["10.1142\/S0219622021500139"],"URL":"https:\/\/doi.org\/10.1142\/s0219622021500139","relation":{},"ISSN":["0219-6220","1793-6845"],"issn-type":[{"value":"0219-6220","type":"print"},{"value":"1793-6845","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,22]]}}}