{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T16:01:50Z","timestamp":1774454510103,"version":"3.50.1"},"reference-count":71,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2018,9,29]],"date-time":"2018-09-29T00:00:00Z","timestamp":1538179200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100009122","name":"Ministry of Higher Education and Scientific Research","doi-asserted-by":"publisher","award":["LR11ES48"],"award-info":[{"award-number":["LR11ES48"]}],"id":[{"id":"10.13039\/100009122","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,7,18]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The evaluation of visual analytics (VA) is a challenging field enabling analysts to get insight into diverse data types and formats. It aims at understanding events described by data and supporting the knowledge discovery process by integrating different data analysis methods. Recently, the evolution of intelligent decision support systems has enabled the inductive and predictive approaches of data analysis to make important decisions faster with a higher level of confidence and lower uncertainty. This paper introduces a new and intelligent evaluation method of VA that understands the users\u2019 work as well as the features of their environments including vagueness, uncertainty and ambiguity due to workload. To this end, we apply an adaptive neuro-fuzzy inference system (ANFIS) to get quantitative and qualitative measures and determine the lowest evaluation score with better approximation. By combining fuzzy logic, used to deal with the inaccuracies and uncertainty problems during the evaluation process, and neural network, used to solve the problem of continuous changes in assessment environments with the delivery of adaptive learning content. By using the ANFIS approach that allows accurate prediction of evaluation scores, the proposed method seems more efficient compared to the recent evaluation methodology.<\/jats:p>","DOI":"10.1093\/comjnl\/bxy091","type":"journal-article","created":{"date-parts":[[2018,9,7]],"date-time":"2018-09-07T15:14:08Z","timestamp":1536333248000},"page":"977-1000","source":"Crossref","is-referenced-by-count":4,"title":["A Predictive Visual Analytics Evaluation Approach Based on Adaptive Neuro-Fuzzy Inference System"],"prefix":"10.1093","volume":"62","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0556-9717","authenticated-orcid":false,"given":"Saber","family":"Amri","sequence":"first","affiliation":[{"name":"REGIM-Lab.: REsearch Groups in Intelligent Machines, National Engineering School of Sfax (ENIS), BP 1173,University of Sfax, Sfax, Tunisia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hela","family":"Ltifi","sequence":"additional","affiliation":[{"name":"REGIM-Lab.: REsearch Groups in Intelligent Machines, National Engineering School of Sfax (ENIS), BP 1173,University of Sfax, Sfax, Tunisia"},{"name":"Computer Sciences and Mathematics Department, Faculty of Sciences and Technology of Sidi Bouzid, University of Kairouan, Sidi Bouzid, Tunisia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mounir","family":"Ben Ayed","sequence":"additional","affiliation":[{"name":"REGIM-Lab.: REsearch Groups in Intelligent Machines, National Engineering School of Sfax (ENIS), BP 1173,University of Sfax, Sfax, Tunisia"},{"name":"Computer Sciences and Communication Department, Faculty of Sciences of Sfax, University of Sfax, Sfax, Tunisia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2018,9,29]]},"reference":[{"key":"2019071809560537500_bxy091C1","volume-title":"Biomedical Informatics: Computer Applications in Health Care and Biomedicine","author":"Shortliffe","year":"2013"},{"issue":"3","key":"2019071809560537500_bxy091C2","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1177\/1473871611407399","article-title":"Developing guidelines for assessing visual analytics environments","volume":"10","author":"Scholtz","year":"2011","journal-title":"Information Visualization"},{"issue":"5","key":"2019071809560537500_bxy091C3","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MCG.2005.102","article-title":"Evaluating visualizations: Do expert reviews work?","volume":"25","author":"Tory","year":"2005","journal-title":"IEEE Comput. Graph. Appl."},{"issue":"2","key":"2019071809560537500_bxy091C4","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/j.giq.2011.10.002","article-title":"Community Health Map: a geospatial and multivariate data visualization tool for public health datasets","volume":"29","author":"Sopan","year":"2012","journal-title":"Gov. Inf. Q."},{"issue":"9","key":"2019071809560537500_bxy091C5","doi-asserted-by":"crossref","first-page":"1504","DOI":"10.1109\/TNN.2009.2027321","article-title":"Supplier selection based on a neural network model using genetic algorithm","volume":"20","author":"Golmohammadi","year":"2009","journal-title":"IEEE Trans. Neural Netw."},{"issue":"2","key":"2019071809560537500_bxy091C6","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1016\/j.ijpe.2011.01.015","article-title":"Neural network application for fuzzy multi-criteria decision making problems","volume":"131","author":"Golmohammadi","year":"2011","journal-title":"Int. J. Prod. Econ."},{"issue":"13","key":"2019071809560537500_bxy091C7","doi-asserted-by":"crossref","first-page":"3903","DOI":"10.1080\/00207543.2012.756592","article-title":"Fuzzy hybrid decision model for supplier evaluation and selection","volume":"51","author":"Pitchipoo","year":"2013","journal-title":"Int. J. Prod. Res."},{"issue":"6","key":"2019071809560537500_bxy091C8","doi-asserted-by":"crossref","first-page":"1668","DOI":"10.1016\/j.asoc.2012.01.023","article-title":"Sustainable supplier selection: a ranking model based on fuzzy inference system","volume":"12","author":"Amindoust","year":"2012","journal-title":"Appl. Soft Comput."},{"issue":"4","key":"2019071809560537500_bxy091C9","doi-asserted-by":"crossref","first-page":"934","DOI":"10.1109\/TFUZZ.2016.2587325","article-title":"Intelligent decision support system for detection and root cause analysis of faults in coal mills","volume":"25","author":"Agrawal","year":"2017","journal-title":"IEEE Trans. Fuzzy Syst."},{"issue":"1","key":"2019071809560537500_bxy091C10","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1016\/j.eswa.2010.07.024","article-title":"Developing an integrated model for the evaluation and selection of six sigma projects based on ANFIS and fuzzy goal programming","volume":"38","author":"Saghaei","year":"2011","journal-title":"Exp. Syst. Appl."},{"issue":"3","key":"2019071809560537500_bxy091C11","doi-asserted-by":"crossref","first-page":"1536","DOI":"10.1021\/ie1015552","article-title":"Modeling of thermal cracking of heavy liquid hydrocarbon: application of kinetic modeling, artificial neural network, and neuro-fuzzy models","volume":"50","author":"Sedighi","year":"2011","journal-title":"Ind. Eng. Chem. Res."},{"issue":"3","key":"2019071809560537500_bxy091C12","doi-asserted-by":"crossref","first-page":"3461","DOI":"10.1016\/j.eswa.2011.09.036","article-title":"Improving response surface methodology by using artificial neural network and simulated annealing","volume":"39","author":"Abbasi","year":"2012","journal-title":"Exp. Syst. Appl."},{"key":"2019071809560537500_bxy091C13","author":"Amri","year":"2017"},{"issue":"1","key":"2019071809560537500_bxy091C14","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/MCG.2006.5","article-title":"A visual analytics agenda","volume":"26","author":"Thomas","year":"2006","journal-title":"IEEE Comput. Graph. Appl."},{"issue":"1","key":"2019071809560537500_bxy091C15","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1177\/1473871614567794","article-title":"Interactive visual knowledge discovery from data-based temporal decision support system","volume":"15","author":"Ltifi","year":"2016","journal-title":"Inf. Vis."},{"issue":"4","key":"2019071809560537500_bxy091C16","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1177\/1473871613490290","article-title":"Evaluation of visual analytics environments: The road to the Visual Analytics Science and Technology challenge evaluation methodology","volume":"13","author":"Scholtz","year":"2014","journal-title":"Inf. Vis."},{"key":"2019071809560537500_bxy091C17","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1007\/978-3-540-70956-5_7","volume-title":"Information Visualization","author":"Keim","year":"2008"},{"issue":"2","key":"2019071809560537500_bxy091C18","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1177\/1473871612462152","article-title":"Orion: a system for modeling, transformation and visualization of multidimensional heterogeneous networks","volume":"13","author":"Heer","year":"2014","journal-title":"Information Visualization"},{"key":"2019071809560537500_bxy091C19","author":"Scholtz","year":"2016"},{"key":"2019071809560537500_bxy091C20","first-page":"034","article-title":"Mechanical analysis and construction process of bridge reinforcement via additional RC with bars and steel fibres","volume":"6","author":"Zhang","year":"2010","journal-title":"J. Northeast. Univ. (Nat. Sci.)"},{"key":"2019071809560537500_bxy091C21","author":"Lush","year":"2015"},{"issue":"10","key":"2019071809560537500_bxy091C22","doi-asserted-by":"crossref","first-page":"1577","DOI":"10.1080\/13658816.2010.508043","article-title":"Space, time and visual analytics","volume":"24","author":"Andrienko","year":"2010","journal-title":"Int. J. Geograph. Inf. Sci."},{"key":"2019071809560537500_bxy091C23","author":"Scholtz","year":"2010"},{"key":"2019071809560537500_bxy091C24","author":"Zuk","year":"2006"},{"issue":"3","key":"2019071809560537500_bxy091C25","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/MCG.2009.56","article-title":"Visual-analytics evaluation","volume":"29","author":"Plaisant","year":"2009","journal-title":"IEEE Comput. Graph. Appl."},{"key":"2019071809560537500_bxy091C26","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/978-3-540-70956-5_2","volume-title":"Information Visualization","author":"Carpendale","year":"2008"},{"issue":"1","key":"2019071809560537500_bxy091C27","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1109\/TVCG.2007.70412","article-title":"Promoting insight-based evaluation of visualizations: from contest to benchmark repository","volume":"14","author":"Plaisant","year":"2008","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"issue":"6","key":"2019071809560537500_bxy091C28","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.3748\/wjg.v8.i6.1023","article-title":"Intravenous chemotherapy for resected gastric cancer: meta-analysis of randomized controlled trials","volume":"8","author":"Hu","year":"2002","journal-title":"World J. Gastroenterol."},{"issue":"5","key":"2019071809560537500_bxy091C29","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1016\/S0040-1625(01)00157-3","article-title":"Automated extraction and visualization of information for technological intelligence and forecasting","volume":"69","author":"Zhu","year":"2002","journal-title":"Technol. Forecast. Soc. Change"},{"issue":"3","key":"2019071809560537500_bxy091C30","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MCG.2006.70","article-title":"Toward measuring visualization insight","volume":"26","author":"North","year":"2006","journal-title":"IEEE Comput. Graph. Appl."},{"issue":"3","key":"2019071809560537500_bxy091C31","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1109\/21.256541","article-title":"ANFIS: adaptive-network-based fuzzy inference system","volume":"23","author":"Jang","year":"1993","journal-title":"IEEE Trans. Syst. Man Cybern."},{"issue":"4","key":"2019071809560537500_bxy091C32","doi-asserted-by":"crossref","first-page":"77","DOI":"10.5430\/air.v3n4p77","article-title":"A hybrid knowledge discovery system for oil spillage risks pattern classification","volume":"3","author":"Inyang","year":"2014","journal-title":"Artif. Intell. Res."},{"key":"2019071809560537500_bxy091C33","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.asoc.2014.11.012","article-title":"The application of ANFIS prediction models for thermal error compensation on CNC machine tools","volume":"27","author":"Abdulshahed","year":"2015","journal-title":"Appl. Soft Comput."},{"issue":"6","key":"2019071809560537500_bxy091C34","doi-asserted-by":"crossref","first-page":"16","DOI":"10.5815\/ijigsp.2013.06.03","article-title":"Mass detection in lung CT images using region growing segmentation and decision making based on fuzzy inference system and artificial neural network","volume":"5","author":"Hashemi","year":"2013","journal-title":"Int. J. Image Graph. Signal Process."},{"key":"2019071809560537500_bxy091C35","doi-asserted-by":"crossref","first-page":"628","DOI":"10.1016\/j.asoc.2015.02.019","article-title":"An ANFIS approach for evaluation of team-level service climate in GSD projects using Taguchi-genetic learning algorithm","volume":"30","author":"Sangaiah","year":"2015","journal-title":"Appl. Soft Comput."},{"key":"2019071809560537500_bxy091C36","author":"Mart\u00ednez","year":"2010"},{"issue":"6","key":"2019071809560537500_bxy091C37","doi-asserted-by":"crossref","first-page":"391","DOI":"10.3103\/S0146411617060062","article-title":"Diagnostic neuro-fuzzy system and its learning in medical data mining tasks in conditions of uncertainty about numbers of attributes and diagnoses","volume":"51","author":"Pliss","year":"2017","journal-title":"Autom. Control Comput. Sci."},{"issue":"10","key":"2019071809560537500_bxy091C38","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.1016\/j.medengphy.2016.07.003","article-title":"Comparison of adaptive neuro-fuzzy inference system (ANFIS) and Gaussian processes for machine learning (GPML) algorithms for the prediction of skin temperature in lower limb prostheses","volume":"38","author":"Mathur","year":"2016","journal-title":"Med. Eng. Phys."},{"issue":"01","key":"2019071809560537500_bxy091C39","doi-asserted-by":"crossref","first-page":"13","DOI":"10.4236\/jtr.2017.51002","article-title":"Evaluation of TB patients characteristics based on predictive data mining approaches","volume":"5","author":"Jahantigh","year":"2017","journal-title":"J. Tuberc. Res."},{"issue":"10","key":"2019071809560537500_bxy091C40","first-page":"78","article-title":"Thyroid diseases forecasting using a hybrid decision support system based on ANFIS, k-NN and information gain method","volume":"7","author":"Ahmad","year":"2017","journal-title":"J. Appl. Environ. Biol. Sci."},{"key":"2019071809560537500_bxy091C41","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1016\/j.catena.2017.05.034","article-title":"Performance evaluation of GIS-based new ensemble data mining techniques of adaptive neuro-fuzzy inference system (ANFIS) with genetic algorithm (GA), differential evolution (DE), and particle swarm optimization (PSO) for landslide spatial modelling","volume":"157","author":"Chen","year":"2017","journal-title":"Catena"},{"key":"2019071809560537500_bxy091C42","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1007\/978-981-10-6620-7_52","volume-title":"Big Data Analytics","author":"Taneja","year":"2018"},{"issue":"1","key":"2019071809560537500_bxy091C43","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/s12061-012-9076-1","article-title":"Dealing with the uncertainty of having incomplete sources of geo-information in spatial planning","volume":"6","author":"Vullings","year":"2013","journal-title":"Appl. Spatial Anal. Policy"},{"issue":"2","key":"2019071809560537500_bxy091C44","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/s12021-015-9287-0","article-title":"Fuzzy-logic based detection and characterization of junctions and terminations in fluorescence microscopy images of neurons","volume":"14","author":"Radojevi\u0107","year":"2016","journal-title":"Neuroinformatics"},{"issue":"10","key":"2019071809560537500_bxy091C45","doi-asserted-by":"crossref","first-page":"1482","DOI":"10.1109\/TAC.1997.633847","article-title":"Neuro-fuzzy and soft computing; a computational approach to learning and machine intelligence","volume":"42","author":"Jang","year":"1997","journal-title":"IEEE Trans. Automat. Contr."},{"key":"2019071809560537500_bxy091C46","author":"Munaga"},{"key":"2019071809560537500_bxy091C47","author":"Kosara","year":"2007"},{"key":"2019071809560537500_bxy091C48","author":"Kurzhals","year":"2014"},{"key":"2019071809560537500_bxy091C49","author":"Fischer","year":"2014"},{"key":"2019071809560537500_bxy091C50","author":"Ragan","year":"2014"},{"key":"2019071809560537500_bxy091C51","author":"Plaisant","year":"2004"},{"key":"2019071809560537500_bxy091C52","first-page":"471","volume-title":"Advances in Knowledge Discovery and Data Mining","author":"Fayyad","year":"1996"},{"issue":"1","key":"2019071809560537500_bxy091C53","doi-asserted-by":"crossref","first-page":"22","DOI":"10.14569\/IJARAI.2012.010105","article-title":"Dynamic decision support system based on Bayesian networks application to fight against the nosocomial infections","volume":"1","author":"Ltifi","year":"2012","journal-title":"Int. J Adv. Res. Artif. Intell."},{"key":"2019071809560537500_bxy091C54","author":"Elouni","year":"2016"},{"key":"2019071809560537500_bxy091C55","author":"Plaisant","year":"1996"},{"key":"2019071809560537500_bxy091C56","first-page":"12","volume-title":"Artificial Neural Network and Its Fusion Application Technique","author":"Luo","year":"2007"},{"key":"2019071809560537500_bxy091C57","first-page":"14","article-title":"Mixed programming method of MATLAB and Visual Studio languages","volume":"4","author":"Dan","year":"2003","journal-title":"Microcomput. Its Appl."},{"issue":"1","key":"2019071809560537500_bxy091C58","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/1473871616674046","article-title":"Fuzzy logic\u2013based evaluation of visualizations generated by intelligent decision support systems","volume":"17","author":"Ltifi","year":"2018","journal-title":"Inf. Vis."},{"key":"2019071809560537500_bxy091C59","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1142\/9789814261302_0021","volume-title":"Fuzzy Sets, Fuzzy Logic, And Fuzzy Systems: Selected Papers","author":"Zadeh","year":"1996"},{"key":"2019071809560537500_bxy091C60","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.fss.2015.07.001","article-title":"Membership function construction for interval-valued fuzzy sets with application to Gaussian noise reduction","volume":"286","author":"Bigand","year":"2016","journal-title":"Fuzzy Sets Syst."},{"issue":"1","key":"2019071809560537500_bxy091C61","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/j.cie.2012.09.015","article-title":"Multi-objective reliability-redundancy allocation problem using particle swarm optimization","volume":"64","author":"Garg","year":"2013","journal-title":"Comput. Industr. Eng."},{"issue":"4","key":"2019071809560537500_bxy091C62","doi-asserted-by":"crossref","first-page":"2347","DOI":"10.1109\/COMST.2015.2444095","article-title":"Internet of things: a survey on enabling technologies, protocols, and applications","volume":"17","author":"Al-Fuqaha","year":"2015","journal-title":"IEEE Commun. Surv. Tutor."},{"issue":"7","key":"2019071809560537500_bxy091C63","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1177\/1352458515572406","article-title":"Demographic and clinical features of neuromyelitis optica: a review","volume":"21","author":"Pandit","year":"2015","journal-title":"Mult. Scler. J."},{"issue":"3","key":"2019071809560537500_bxy091C64","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1177\/0363546515618387","article-title":"An in vitro robotic assessment of the anterolateral ligament, part 1: secondary role of the anterolateral ligament in the setting of an anterior cruciate ligament injury","volume":"44","author":"Rasmussen","year":"2016","journal-title":"Am. J. Sports Med."},{"issue":"1","key":"2019071809560537500_bxy091C65","first-page":"14","article-title":"Approximations of fuzzy systems","volume":"1","author":"Singh","year":"2013","journal-title":"Indonesian J. Elect. Eng. Informat."},{"key":"2019071809560537500_bxy091C66","author":"Bahloul","year":"2010"},{"key":"2019071809560537500_bxy091C67","author":"Chang","year":"2010"},{"issue":"1","key":"2019071809560537500_bxy091C68","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/TVCG.2015.2467871","article-title":"VA 2: a visual analytics approach for evaluating visual analytics applications","volume":"22","author":"Blascheck","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"2019071809560537500_bxy091C69","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1016\/j.asoc.2014.06.032","article-title":"Comparison of neural network application for fuzzy and ANFIS approaches for multi-criteria decision making problems","volume":"24","author":"\u00d6zkan","year":"2014","journal-title":"Appl. Soft Comput."},{"key":"2019071809560537500_bxy091C70","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1007\/978-1-4842-2734-3_5","volume-title":"Introduction to Deep Learning Using R","author":"Beysolow","year":"2017"},{"key":"2019071809560537500_bxy091C71","author":"Adebayo","year":"2018"}],"container-title":["The Computer Journal"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/comjnl\/article-pdf\/62\/7\/977\/28952462\/bxy091.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,9,20]],"date-time":"2019-09-20T08:44:27Z","timestamp":1568969067000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/comjnl\/article\/62\/7\/977\/5110549"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,9,29]]},"references-count":71,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2018,9,29]]},"published-print":{"date-parts":[[2019,7,18]]}},"URL":"https:\/\/doi.org\/10.1093\/comjnl\/bxy091","relation":{},"ISSN":["0010-4620","1460-2067"],"issn-type":[{"value":"0010-4620","type":"print"},{"value":"1460-2067","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,7]]},"published":{"date-parts":[[2018,9,29]]}}}