{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,30]],"date-time":"2025-12-30T03:41:21Z","timestamp":1767066081540,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2022,5,26]],"date-time":"2022-05-26T00:00:00Z","timestamp":1653523200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Universidad de Las Am\u00e9ricas-Ecuador","award":["INI.PAV.20.01."],"award-info":[{"award-number":["INI.PAV.20.01."]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Data"],"abstract":"<jats:p>A systematic literature review is a synthesis of the available evidence, in which a review of quantitative and qualitative aspects of primary studies is carried out, to summarize the existing information regarding a particular topic. The researchers extract key criteria from papers collected about their study area, answering research questions and conducting document analysis. Nonetheless, in some cases, these criteria are improperly justified, unknowing their true level of importance in the study subject. Hence, an additional study is necessary to explain the criteria relevance in the papers studied using qualitative and quantitative premises. The correct identification of these key criteria is a critical factor in prioritizing and achieving appropriate results in any scientific research work. In our paper, a new method to determine key criteria from a literature review is proposed, composed of three components: input-process-output. First, the inputs are a set of criteria to evaluate and a set of documents to analyze. Next, the process component examines the document set to indicate whether the criteria to be analyzed are found. The process component produces a Boolean matrix, which is the input of the mathematical logic process that will get the key criteria considered necessary and sufficient as the output component. The iKeyCriteria method has been applied in different computing domains, particularly for serious games design and virtual organizations, giving positive results in each context. Finally, we developed an online tool that provides global support to the execution of our method.<\/jats:p>","DOI":"10.3390\/data7060070","type":"journal-article","created":{"date-parts":[[2022,5,26]],"date-time":"2022-05-26T08:50:22Z","timestamp":1653555022000},"page":"70","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["iKeyCriteria: A Qualitative and Quantitative Analysis Method to Infer Key Criteria since a Systematic Literature Review for the Computing Domain"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5720-1960","authenticated-orcid":false,"given":"Mayra","family":"Carri\u00f3n-Toro","sequence":"first","affiliation":[{"name":"Departamento de Inform\u00e1tica y Ciencias de la Computaci\u00f3n, Escuela Polit\u00e9cnica Nacional, Quito 170525, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4194-6882","authenticated-orcid":false,"given":"Jose","family":"Aguilar","sequence":"additional","affiliation":[{"name":"Centro de Estudios en Microelectr\u00f3nica y Sistemas Distribuidos, Universidad de Los Andes, M\u00e9rida 5101, Venezuela"},{"name":"GIDITIC, Universidad EAFIT, Medell\u00edn 050022, Colombia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7251-923X","authenticated-orcid":false,"given":"Marco","family":"Sant\u00f3rum","sequence":"additional","affiliation":[{"name":"Departamento de Inform\u00e1tica y Ciencias de la Computaci\u00f3n, Escuela Polit\u00e9cnica Nacional, Quito 170525, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9628-2767","authenticated-orcid":false,"given":"Mar\u00eda","family":"P\u00e9rez","sequence":"additional","affiliation":[{"name":"Departamento de Inform\u00e1tica y Ciencias de la Computaci\u00f3n, Escuela Polit\u00e9cnica Nacional, Quito 170525, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7664-9098","authenticated-orcid":false,"given":"Boris","family":"Astudillo","sequence":"additional","affiliation":[{"name":"Departamento de Inform\u00e1tica y Ciencias de la Computaci\u00f3n, Escuela Polit\u00e9cnica Nacional, Quito 170525, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9182-6865","authenticated-orcid":false,"given":"Cindy-Pamela","family":"Lopez","sequence":"additional","affiliation":[{"name":"Departamento de Inform\u00e1tica y Ciencias de la Computaci\u00f3n, Escuela Polit\u00e9cnica Nacional, Quito 170525, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4965-0691","authenticated-orcid":false,"given":"Marcelo","family":"Nieto","sequence":"additional","affiliation":[{"name":"Departamento de Inform\u00e1tica y Ciencias de la Computaci\u00f3n, Escuela Polit\u00e9cnica Nacional, Quito 170525, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4210-0117","authenticated-orcid":false,"given":"Patricia","family":"Acosta-Vargas","sequence":"additional","affiliation":[{"name":"Intelligent and Interactive Systems Laboratory, Universidad de Las Am\u00e9ricas, Quito 170125, Ecuador"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,26]]},"reference":[{"key":"ref_1","unstructured":"Lame, G. (2019, January 24\u201328). Systematic literature reviews: An introduction. Proceedings of the International Conference on Engineering Design, ICED, Bordeaux, France."},{"key":"ref_2","first-page":"1051","article-title":"Guidelines for performing Systematic Literature reviews in Software Engineering","volume":"45","author":"Kitchenham","year":"2007","journal-title":"Engineering"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ibrahim, A., Ahmed, M., Conway, R., and Carey, J.J. (2019). Risk of infection with methotrexate therapy in inflammatory diseases: A systematic review and meta-analysis. J. Clin. Med., 8.","DOI":"10.3390\/jcm8010015"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.jbusres.2019.07.039","article-title":"Literature review as a research methodology: An overview and guidelines","volume":"104","author":"Snyder","year":"2019","journal-title":"J. Bus. Res."},{"key":"ref_5","unstructured":"Carri\u00f3n, M., Santorum, M., Pinaida, A., and Aguilar, J. (2019, January 13\u201315). Estudio para inferir criterios clave para el dise\u00f1o de Juegos Serios. Proceedings of the 2019 International Conference on Information Systems and Software Technologies (ICI2ST), Quito, Ecuador."},{"key":"ref_6","unstructured":"Quimbita, L., and Santorum, M. (2020). Estudio de Metodolog\u00edas Participativas y de Enfoques Centrados en el Usuario para la definici\u00f3n de una Metodoog\u00eda de Dise\u00f1o de Juegos Serios Educativos. [Ph.D. Thesis, Escuela Polit\u00e9cnica Nacional]."},{"key":"ref_7","unstructured":"Guamushig, T., Lopez, C., and Santorum, M. (2020). An\u00e1lisis y Caracterizaci\u00f3n de las Organizaciones Virtuales para la Colaboraci\u00f3n en el Contexto de la Industria 4.0. [Ph.D. Thesis, Escuela Polit\u00e9cnica Nacional]."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Pavli\u010d, J., Toma\u017ei\u010d, T., and Ko\u017euh, I. (2021). The impact of emerging technology influences product placement effectiveness: A scoping study from interactive marketing perspective. J. Res. Interact. Mark.","DOI":"10.1108\/JRIM-02-2021-0041"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1023\/B:QUQU.0000043126.25329.85","article-title":"A strategy to identify critical appraisal criteria for primary mixed-method studies","volume":"38","author":"Sale","year":"2004","journal-title":"Qual. Quant."},{"key":"ref_10","first-page":"149","article-title":"Criteria definition and approaches in green supplier selection\u2014A case study for raw material and packaging of food industry","volume":"3","author":"Banaeian","year":"2015","journal-title":"Prod. Manuf. Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"729","DOI":"10.1016\/j.chb.2014.10.062","article-title":"Selection criteria for text mining approaches","volume":"51","author":"Hashimi","year":"2015","journal-title":"Comput. Hum. Behav."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Dohale, V.D., Akarte, M.M., and Verma, P. (2019, January 15\u201318). Determining the Process Choice Criteria for Selecting a Production System in a Manufacturing Firm Using a Delphi Technique. Proceedings of the International Conference on Industrial Engineering and Engineering Management (IEEM), Macao, China.","DOI":"10.1109\/IEEM44572.2019.8978820"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"85","DOI":"10.36965\/OJAKM.2020.8(1)85-98","article-title":"Online Journal of Applied Knowledge Management Key criteria of ERP\/CRM systems selection in SMEs in Poland","volume":"8","author":"Cieciora","year":"2020","journal-title":"Online J. Appl. Knowl. Manag."},{"key":"ref_14","unstructured":"International Organization for Standardization (2018). Systems and Software Engineering\u2014Life Cycle Processes\u2014Requirements Eengineering Inginierie, International Organization for Standardization."},{"key":"ref_15","unstructured":"Manning, C.D., Raghavan, P., and Schutze, H. (2009). An Introduction to Information Retrieval, Cambridge University Press."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Esteves, R.A., Wang, C., and Kraft, M. (2022). Python-based open-source electro-mechanical co-optimization system for MEMS inertial sensors. Micromachines, 13.","DOI":"10.3390\/mi13010001"},{"key":"ref_17","unstructured":"(2022, May 16). Django. Django Documentation. Available online: https:\/\/docs.djangoproject.com\/en\/4.0\/."},{"key":"ref_18","first-page":"1155","article-title":"Proposal of a methodology of serious games\u2019 demystification for the teaching of technical modules","volume":"10\u201313","author":"Bousbia","year":"2016","journal-title":"IEEE Glob. Eng. Educ. Conf. EDUCON"},{"key":"ref_19","unstructured":"M\u0327ehmet, C. (2012). A methodological approach for serious game software development: An application for language disorders. [Master Thesis, Atilim University]."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"64","DOI":"10.4018\/IJITSA.2015070105","article-title":"Agile software development process applied to the serious games development for children from 7 to 10 years old","volume":"8","author":"Cano","year":"2015","journal-title":"Int. J. Inf. Technol. Syst. Approach"},{"key":"ref_21","unstructured":"Cano, S.P. (2016). Propuesta Metodol\u00f3gica para el Dise\u00f1o de Juegos Serios para Ni\u00f1os con Implante Coclear. [Ph.D. Thesis, Universidad del Cauca]."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lepe-Salazar, F. (2015, January 16\u201319). A model to analyze and design educational games with pedagogical foundations. Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology\u2014ACE \u201915, Iskandar, Malaysia.","DOI":"10.1145\/2832932.2832951"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1177\/1046878108319278","article-title":"EMERGO: A methodology and toolkit for developing serious games in higher education","volume":"39","author":"Nadolski","year":"2008","journal-title":"Simul. Gaming"},{"key":"ref_24","first-page":"2","article-title":"KASP: A Cognitive-Affective Methodology for Designing Serious Learning Games","volume":"9","author":"Najoua","year":"2018","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"De Lope, R.P., Medina-medina, N., Soldado Montes, R., Mora Garc\u00eda, A., and Guti\u00e9rrez-vela, F.L. (2017, January 6\u20138). Designing educational games: Key elements and methodological approach. Proceedings of the 9th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), Athens, Greece.","DOI":"10.1109\/VS-GAMES.2017.8055812"},{"key":"ref_26","unstructured":"Padilla, N. (2011). Metodolog\u00eda Para El Dise\u00f1o De Videojuegos Educativos Sobre Una Arquitectura Para El An\u00e1lisis Del Aprendizaje Colaborativo. [Ph.D. Thesis, Universidad de Granada]."},{"key":"ref_27","first-page":"90","article-title":"Design methodology for educational games based on interactive screenplays","volume":"1394","author":"Paderewski","year":"2015","journal-title":"CEUR Workshop Proc."},{"key":"ref_28","unstructured":"Tran, C.D., George, S., and Marfisi-Schottman, I. (2010, January 21\u201322). EDoS: An authoring environment for serious games design based on three models. Proceedings of the 4th European Conference on Games Based Learning 2010, ECGBL, Copenhagen, Denmark."},{"key":"ref_29","unstructured":"Kuhrmann, M., and Ternit\u00e9, T. (2006). Including the Microsoft Solution Framework as an agile method into the V-Modell XT. Eval. Nov. Approaches Softw. Eng."},{"key":"ref_30","first-page":"83","article-title":"Metodolog\u00eda de Software MSF en peque\u00f1as empresas MSF software methodology in small businesses","volume":"4","year":"2012","journal-title":"Cuad. Act."},{"key":"ref_31","unstructured":"Balduino, R. (2007). Introduction to OpenUP (Open Unified Process). Organization, 1\u20139."},{"key":"ref_32","first-page":"40","article-title":"The essential unified process","volume":"31","author":"Jacobson","year":"2006","journal-title":"Dr. Dobb\u2019s J."},{"key":"ref_33","first-page":"43","article-title":"The Waterfall Approach and Requirement Uncertainty","volume":"1","author":"Ruel","year":"2010","journal-title":"Int. J. Inf. Technol. Proj. Manag."},{"key":"ref_34","first-page":"386","article-title":"The waterfall model in large-scale development","volume":"32","author":"Petersen","year":"2009","journal-title":"Lect. Notes Bus. Inf. Process."},{"key":"ref_35","unstructured":"Company, R. (2005). Rational Unified Process for Systems Engineering, Company, R."},{"key":"ref_36","unstructured":"Zuehlke Engineering (2022, April 28). Unified Software Development Process; Technical Report; Zuehlke Engineering. Available online: http:\/\/www0.cs.ucl.ac.uk\/staff\/ucacwxe\/lectures\/3C05-01-02\/aswe5.pdf."},{"key":"ref_37","unstructured":"Kruchten, P. (2000). The Rational Unified Process An Introduction, Addison-Wesley Professional. [2nd ed.]."},{"key":"ref_38","first-page":"1","article-title":"An Unified Process adaptation for the development of Joomla based web applications","volume":"Volume XII","author":"Leyva","year":"2006","journal-title":"Ciencias Holgu\u00edn"},{"key":"ref_39","first-page":"3","article-title":"Metodolog\u00eda \u00e1gil Crystal Clear. Un caso de estudio","volume":"2","author":"Abreu","year":"2009","journal-title":"Ser. Cient."},{"key":"ref_40","first-page":"159","article-title":"Las Metodolog\u00edas de Desarrollo \u00c1gil como una Oportunidad para la Ingenier\u00eda del Software Educativo","volume":"5","author":"Duarte","year":"2008","journal-title":"Rev. Av. Sist. Inform."},{"key":"ref_41","unstructured":"Schwaber, K., and Sutherland, J. (2022, April 24). La Gu\u00eda definitiva de Scrum: Las Reglas del Juego, Scrum Guides. Available online: https:\/\/scrumguides.org\/docs\/scrumguide\/v2020\/2020-Scrum-Guide-Spanish-Latin-South-American.pdf."},{"key":"ref_42","unstructured":"Tobergte, D.R., and Curtis, S. (2013). Ingenieria de Software un enfoque practico. arXiv."},{"key":"ref_43","unstructured":"Carri\u00f3n-Toro, M. (2022, May 16). \u201ctf-idf metric iKeyCriteria (dataset)\u201d, Mendeley Data, V1. Available online: https:\/\/data.mendeley.com\/datasets\/jc8k4cnr2c\/1."}],"container-title":["Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5729\/7\/6\/70\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:18:49Z","timestamp":1760138329000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5729\/7\/6\/70"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,26]]},"references-count":43,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["data7060070"],"URL":"https:\/\/doi.org\/10.3390\/data7060070","relation":{},"ISSN":["2306-5729"],"issn-type":[{"type":"electronic","value":"2306-5729"}],"subject":[],"published":{"date-parts":[[2022,5,26]]}}}