{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T17:13:30Z","timestamp":1773940410369,"version":"3.50.1"},"reference-count":40,"publisher":"World Scientific Pub Co Pte Lt","issue":"01","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Info. Tech. Dec. Mak."],"published-print":{"date-parts":[[2012,1]]},"abstract":"<jats:p> Classification algorithm selection is an important issue in many disciplines. Since it normally involves more than one criterion, the task of algorithm selection can be modeled as multiple criteria decision making (MCDM) problems. Different MCDM methods evaluate classifiers from different aspects and thus they may produce divergent rankings of classifiers. The goal of this paper is to propose an approach to resolve disagreements among MCDM methods based on Spearman's rank correlation coefficient. Five MCDM methods are examined using 17 classification algorithms and 10 performance criteria over 11 public-domain binary classification datasets in the experimental study. The rankings of classifiers are quite different at first. After applying the proposed approach, the differences among MCDM rankings are largely reduced. The experimental results prove that the proposed approach can resolve conflicting MCDM rankings and reach an agreement among different MCDM methods. <\/jats:p>","DOI":"10.1142\/s0219622012500095","type":"journal-article","created":{"date-parts":[[2012,2,1]],"date-time":"2012-02-01T10:14:10Z","timestamp":1328091250000},"page":"197-225","source":"Crossref","is-referenced-by-count":523,"title":["EVALUATION OF CLASSIFICATION ALGORITHMS USING MCDM AND RANK CORRELATION"],"prefix":"10.1142","volume":"11","author":[{"given":"GANG","family":"KOU","sequence":"first","affiliation":[{"name":"School of Management and Economics, University of Electronic Science and Technology of China, Chengdu, 610054, P. R. China"}]},{"given":"YANQUN","family":"LU","sequence":"additional","affiliation":[{"name":"School of Management and Economics, University of Electronic Science and Technology of China, Chengdu, 610054, P. R. China"}]},{"given":"YI","family":"PENG","sequence":"additional","affiliation":[{"name":"School of Management and Economics, University of Electronic Science and Technology of China, Chengdu, 610054, P. R. China"}]},{"given":"YONG","family":"SHI","sequence":"additional","affiliation":[{"name":"College of Information Science &amp; Technology, University of Nebraska at Omaha, Omaha, NE 68182, USA"},{"name":"CAS Research Center on Fictitious Economy and Data Sciences, Beijing 100080, China"}]}],"member":"219","published-online":{"date-parts":[[2012,4,6]]},"reference":[{"key":"rf1","volume-title":"Modern Information Retrieval","author":"Baeza-Yates R.","year":"1999"},{"key":"rf2","unstructured":"J. P.\u00a0Brans, L'aide \u00e0 la d\u00e9cision: Nature, Instruments et Perspectives d'Avenir, eds. R.\u00a0Nadeau and M.\u00a0Landry (Presses de l'Universit\u00e9 Laval, Qu\u00e9bec, Canada, 1982)\u00a0pp. 183\u2013213."},{"key":"rf3","doi-asserted-by":"publisher","DOI":"10.1007\/0-387-23081-5_5"},{"key":"rf5","first-page":"288","volume":"1","author":"Deng J.","journal-title":"Systems and Control Letters"},{"key":"rf6","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007413511361"},{"key":"rf7","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2011.03.014"},{"key":"rf8","author":"Ergu D.","journal-title":"Computers & Operations Research"},{"key":"rf9","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2008.08.010"},{"key":"rf11","doi-asserted-by":"publisher","DOI":"10.1007\/b100605"},{"key":"rf14","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2007.10.025"},{"key":"rf15","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-48318-9"},{"key":"rf16","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656278"},{"key":"rf17","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022631118932"},{"key":"rf19","doi-asserted-by":"publisher","DOI":"10.1007\/s10479-005-6245-5"},{"key":"rf20","author":"Kou G.","journal-title":"Annals of Operations Research"},{"key":"rf21","doi-asserted-by":"publisher","DOI":"10.1002\/0471660264"},{"key":"rf22","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2007.12.002"},{"key":"rf23","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2010.02.004"},{"key":"rf24","first-page":"19","volume":"2006","author":"Milani A. S.","journal-title":"Journal of Applied Mathematics and Decision Sciences"},{"key":"rf27","doi-asserted-by":"publisher","DOI":"10.1016\/j.mcm.2004.10.003"},{"key":"rf29","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(03)00020-1"},{"key":"rf30","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8667.00269"},{"key":"rf31","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622008003204"},{"key":"rf32","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2007.12.001"},{"key":"rf33","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622011004282"},{"key":"rf34","doi-asserted-by":"publisher","DOI":"10.1016\/j.omega.2011.01.009"},{"key":"rf35","author":"Peng Y.","journal-title":"Information Sciences"},{"key":"rf36","volume-title":"C4.5: Programs for Machine Learning","author":"Quinlan J. R.","year":"1993"},{"key":"rf37","doi-asserted-by":"publisher","DOI":"10.1016\/S0065-2458(08)60520-3"},{"key":"rf38","first-page":"57","volume":"8","author":"Roy B.","journal-title":"R.I.R.O"},{"key":"rf39","volume-title":"Aide Multicritere a la Decision: Methodes et cas","author":"Roy B.","year":"1993"},{"key":"rf40","first-page":"3","volume":"20","author":"Roy B.","journal-title":"Cahiers du CERO"},{"key":"rf41","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-009-9124-7"},{"key":"rf42","volume":"41","author":"Smith-Miles K. A.","journal-title":"ACM Computing Surveys"},{"key":"rf43","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622010003944"},{"key":"rf44","doi-asserted-by":"publisher","DOI":"10.1109\/TEM.2005.845221"},{"key":"rf45","volume-title":"Data Mining: Practical Machine Learning Tools and Techniques","author":"Witten I. H.","year":"2005"},{"key":"rf47","volume-title":"Computer Systems that Learn: Classification and Predication Methods from Statistics, Neural Nets. Machine Learning and Expert Systems","author":"Weiss S. M.","year":"1991"},{"key":"rf48","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2008.06.003"},{"key":"rf49","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622009003375"}],"container-title":["International Journal of Information Technology &amp; Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0219622012500095","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,6]],"date-time":"2019-08-06T12:33:24Z","timestamp":1565094804000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0219622012500095"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,1]]},"references-count":40,"journal-issue":{"issue":"01","published-online":{"date-parts":[[2012,4,6]]},"published-print":{"date-parts":[[2012,1]]}},"alternative-id":["10.1142\/S0219622012500095"],"URL":"https:\/\/doi.org\/10.1142\/s0219622012500095","relation":{},"ISSN":["0219-6220","1793-6845"],"issn-type":[{"value":"0219-6220","type":"print"},{"value":"1793-6845","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,1]]}}}