{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T06:37:47Z","timestamp":1777703867918,"version":"3.51.4"},"reference-count":57,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2019,10,30]],"date-time":"2019-10-30T00:00:00Z","timestamp":1572393600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"published-print":{"date-parts":[[2019,12,23]]},"abstract":"<jats:p>Execution traces comprehension is an important topic in computer science since it allows software engineers to get a better understanding of the system behavior. However, traces are usually very large and hence they are difficult to interpret. Parallel, execution traces comprehension is a very important topic into the algorithms learning courses since it allows students to get a better understanding of the algorithm behavior. Therefore, there is a need to investigate ways to help students (and teachers) find and understand important information conveyed in a trace despite the trace being massive.<\/jats:p>\n                  <jats:p>In this paper, we propose a new approximation for execution traces comprehension based on fuzzy linguistic descriptions. A new methodology and a data-driven architecture based on linguistic modelling of complex phenomenon are presented and explained. In particular, they are applied to automatically generate linguistic reports from execution traces generated during the execution of algorithm implemented by the students of an introductory course of artificial intelligence. To the best of our knowledge, it is the first time that linguistic modelling of complex phenomenon is applied to execution traces comprehension.<\/jats:p>\n                  <jats:p>Throughout the article, it is shown how this kind of technology can be employed as a useful computer-assisted assessment tool that provides students and teachers with technical, immediate and personalised feedback about the algorithms that are being studied and implemented. At the same time, they provide us with two useful applications: they are an indispensable pedagogical resource for improving comprehension of execution traces, and they play an important role in the process of measuring and evaluating the \u201cbelievability\u201d of the agents implemented.<\/jats:p>\n                  <jats:p>To show and explore the possibilities of this new technology, a web platform has been designed and implemented by one of the authors, and it has been incorporated into the process of assessment of an introductory artificial intelligence course. Finally, an empirical evaluation to confirm our hypothesis was performed and a survey directed to the students was carried out to measure the quality of the learning-teaching process by using this methodology enriched with fuzzy linguistic descriptions.<\/jats:p>","DOI":"10.3233\/jifs-190935","type":"journal-article","created":{"date-parts":[[2019,11,1]],"date-time":"2019-11-01T11:46:02Z","timestamp":1572608762000},"page":"8397-8415","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["Fuzzy linguistic descriptions for execution trace comprehension and their application in an introductory course in artificial intelligence"],"prefix":"10.1177","volume":"37","author":[{"given":"Clemente","family":"Rubio-Manzano","sequence":"first","affiliation":[{"name":"University of C\u00e1diz, Spain"},{"name":"University of the B\u00edo-B\u00edo, Chile"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tom\u00e1s","family":"Lermanda Senocea\u00edn","sequence":"additional","affiliation":[{"name":"University of the B\u00edo-B\u00edo, Chile"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Claudia","family":"Martinez-Araneda","sequence":"additional","affiliation":[{"name":"University of Cat\u00f3lica de la Sant\u00edsima Concepci00F3n, Chile"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian","family":"Vidal-Castro","sequence":"additional","affiliation":[{"name":"University of the B\u00edo-B\u00edo, Chile"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alejandra","family":"Segura-Navarrete","sequence":"additional","affiliation":[{"name":"University of the B\u00edo-B\u00edo, Chile"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2019,10,30]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"FaesslerL. HinterbergerH. DahindenM. and WyssM. Evaluating student motivation in constructivistic problembased introductory computer science courses in E-Learn: World Conference on E-Learning in Corporate Government Healthcare and Higher Education Association for the Advancement of Computing in Education (AACE) 2006 pp. 1178\u20131185."},{"key":"e_1_3_2_3_2","unstructured":"FinkL.D. Creating significant learning experiences: An integrated approach to designing college courses. John Wiley & Sons 2013."},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.3102\/003465430298487"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1080\/03075070600572090"},{"issue":"1","key":"e_1_3_2_6_2","first-page":"115","article-title":"Student and instructor responses to emotional motivational feedback messages in an online instructional environment","volume":"16","author":"Sarsar H.S.","year":"2017","unstructured":"SarsarH.S., and F., Student and instructor responses to emotional motivational feedback messages in an online instructional environment, Turkish Online Journal of Educational Technology - TOJET 16(1) (2017), 115\u2013127.","journal-title":"Turkish Online Journal of Educational Technology - TOJET"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2011.07.020"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1108\/10650740911004787"},{"key":"e_1_3_2_9_2","unstructured":"LavoletteE. The accuracy of computer-assisted feedback and students responses to it 19 (2015)."},{"key":"e_1_3_2_10_2","doi-asserted-by":"crossref","unstructured":"PirzadehH. Hamou-LhadjA. and ShahM. Exploiting text mining techniques in the analysis of execution traces in Software Maintenance (ICSM) 2011 27th IEEE International Conference on IEEE 2011 pp. 223\u2013232.","DOI":"10.1109\/ICSM.2011.6080789"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2010.07.013"},{"key":"e_1_3_2_12_2","unstructured":"P\u00e9rezD. GliozzoA.M. StrapparavaC. AlfonsecaE. Rodr\u00edguezP. and MagniniB. Automatic assessment of students\u2019 free-text answers underpinned by the combination of a bleu-inspired algorithm and latent semantic analysis in Proceedings of the Eighteenth International Florida Artificial Intelligence Research Society Conference Clearwater Beach Florida USA 2005 pp. 358\u2013363."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2017.03.008"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2016.05.082"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/1163405.1163409"},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","unstructured":"BurgosD. Van NimwegenC. Van OostendorpH. and KoperR. Game-based learning and the role of feedback. A case study 2007.","DOI":"10.2316\/Journal.208.2007.4.208-0918"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0019-9958(65)90241-X"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.3233\/JIFS-169119"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1002\/int.21835"},{"key":"e_1_3_2_20_2","unstructured":"GkatziaD. HastieH.F. JanarthanamS. and LemonO. Generating student feedback from time-series data using reinforcement learning in ENLG 2013 - Proceedings of the 14th EuropeanWorkshop on Natural Language Generation Sofia Bulgaria 2013 pp. 115\u2013124."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.04.069"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2016.07.002"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.3233\/JIFS-182919"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sbspro.2010.12.171"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.3233\/JIFS-181648"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40314-019-0843-3"},{"key":"e_1_3_2_27_2","first-page":"131","article-title":"Fuzzy parameterized fuzzy soft compact spaces with decision-making","volume":"50","author":"Riaz M.","year":"2018","unstructured":"RiazM. and HashmiM. R., Fuzzy parameterized fuzzy soft compact spaces with decision-making, Punjab Univ j Math 50 (2018), 131\u2013145.","journal-title":"Punjab Univ j Math"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/64.294135"},{"key":"e_1_3_2_29_2","unstructured":"CochJ. System demonstration interactive generation and knowledge administration in multimeteo Natural Language Generation (1998)."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2008.12.002"},{"key":"e_1_3_2_31_2","unstructured":"WhiteM. and CaldwellT. EXEMPLARS: A practical extensible framework for dynamic text generation in Proceedings of the Ninth International Workshop on Natural Language Generation INLG 1998 Niagara-on-the-Lake Ontario Canada 1998 1998."},{"key":"e_1_3_2_32_2","unstructured":"BusemannS. and HoracekH. Generating air quality reports from environmental data in Proceedings of the DFKIWorkshop on Natural Language Generation 1997 pp. 15\u201321."},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.5477"},{"key":"e_1_3_2_34_2","doi-asserted-by":"crossref","unstructured":"YagerR.R. Fuzzy summaries in database mining in Artificial Intelligence for Applications 1995 Proceedings 11th Conference on IEEE 1995 pp. 265\u2013269.","DOI":"10.1109\/CAIA.1995.378813"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.fss.2015.12.003"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.fss.2015.06.019"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/0020-0255(75)90036-5"},{"key":"e_1_3_2_38_2","doi-asserted-by":"crossref","unstructured":"Ramos-SotoA. Bugar\u00ednA. BarroS. GallegoN. Rodr\u00edguezC. FragaI. and SaundersA. Automatic generation of air quality index textual forecasts using a data-to-text approach in Advances in Artificial Intelligence - 16th Conference of the Spanish Association for Artificial Intelligence CAEPIA 2015 Albacete Spain Proceedings 2015 pp. 164\u2013174.","DOI":"10.1007\/978-3-319-24598-0_15"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TFUZZ.2014.2328011"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijar.2012.07.004"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.05.031"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2016.11.002"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-016-2430-5"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.07.060"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2013.08.003"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2013.05.005"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2012.09.007"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/81.739259"},{"key":"e_1_3_2_49_2","doi-asserted-by":"crossref","unstructured":"BernardiM.L. CimitileM. MartinelliF. and MercaldoF. An ensemble fuzzy logic approach to game bot detection through behavioural features in 2018 IEEE International Conference on Fuzzy Systems FUZZ-IEEE 2018 Rio de Janeiro Brazil 2018 pp. 1\u20139.","DOI":"10.1109\/FUZZ-IEEE.2018.8491615"},{"key":"e_1_3_2_50_2","doi-asserted-by":"crossref","unstructured":"PachecoC. TokarchukL. and P\u00e9rez-Li\u00e9banaD. Studying believability assessment in racing games in Proceedings of the 13th International Conference on the Foundations of Digital Games FDG 2018 Malm\u00f6 Sweden 2018 pp. 20:1\u201320:10.","DOI":"10.1145\/3235765.3235797"},{"key":"e_1_3_2_51_2","doi-asserted-by":"crossref","unstructured":"WangJ.-Y. Classification of humans and bots in two typical two-player computer games in 2018 3rd International Conference on Computer and Communication Systems (ICCCS) IEEE 2018 pp. 502\u2013505.","DOI":"10.1109\/CCOMS.2018.8463277"},{"key":"e_1_3_2_52_2","doi-asserted-by":"crossref","unstructured":"Rubio-ManzanoC. Similarity Measure Between Linguistic Terms by Using Restricted Equivalence Functions and Its Application to Expert Systems Springer International Publishing Cham 2019 pp. 97\u2013102.","DOI":"10.1007\/978-3-030-00485-9_11"},{"key":"e_1_3_2_53_2","unstructured":"BatyrshinI. CrossV. KreinovichV. and RifqiM. Special issue on similarity correlation and association measures dedicated to the memory of lotfi zadeh Journal of Intelligent & Fuzzy Systems Preprint 1\u20132."},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.fss.2006.03.018"},{"key":"e_1_3_2_55_2","doi-asserted-by":"crossref","unstructured":"AlonsoJ.M. Conde-ClementeP. and Trivi\u00f1oG. Linguistic description of complex phenomena with the rldcp R package in Proceedings of the 10th International Conference on Natural Language Generation INLG 2017 Santiago de Compostela Spain 2017 pp. 243\u2013244.","DOI":"10.18653\/v1\/W17-3538"},{"key":"e_1_3_2_56_2","doi-asserted-by":"crossref","unstructured":"SoniB. and HingstonP. Bots trained to play like a human are more fun in Proceedings of the International Joint Conference on Neural Networks IJCNN 2008 part of the IEEE World Congress on Computational Intelligence WCCI 2008 Hong Kong China 2008 pp. 363\u2013369.","DOI":"10.1109\/IJCNN.2008.4633818"},{"issue":"3","key":"e_1_3_2_57_2","first-page":"169","article-title":"A turing test for computer game bots","volume":"1","author":"Hingston P.","year":"2009","unstructured":"HingstonP., A turing test for computer game bots, IEEE Trans Comput Intellig and AI in Games 1(3) (2009), 169\u2013186.","journal-title":"IEEE Trans Comput Intellig and AI in Games"},{"key":"e_1_3_2_58_2","unstructured":"ManD.P. Automatic evaluation of users short essays by using statistical and shallow natural language processing techniques advanced studies diploma work 2004."}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-190935","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/JIFS-190935","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-190935","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:39:50Z","timestamp":1777455590000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/JIFS-190935"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,30]]},"references-count":57,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2019,12,23]]}},"alternative-id":["10.3233\/JIFS-190935"],"URL":"https:\/\/doi.org\/10.3233\/jifs-190935","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,30]]}}}