{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T23:44:02Z","timestamp":1792799042167,"version":"4.5.0"},"reference-count":110,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2019,9,13]],"date-time":"2019-09-13T00:00:00Z","timestamp":1568332800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001807","name":"FAPESP","doi-asserted-by":"crossref","award":["2012\/22608-8"],"award-info":[{"award-number":["2012\/22608-8"]}],"id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior - Brasil (CAPES) -Finance Code 001","id":[{"id":"https:\/\/ror.org\/00x0ma614","id-type":"ROR","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003593","name":"CNPq","doi-asserted-by":"crossref","award":["308858\/2014-0 and 305291\/2017-3"],"award-info":[{"award-number":["308858\/2014-0 and 305291\/2017-3"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"crossref"}]},{"name":"CAPES-COFECUB"},{"DOI":"10.13039\/501100002322","name":"CAPES","doi-asserted-by":"crossref","award":["88887.162551\/2018-00"],"award-info":[{"award-number":["88887.162551\/2018-00"]}],"id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2020,9,30]]},"abstract":"<jats:p>Characteristics extracted from the training datasets of classification problems have proven to be effective predictors in a number of meta-analyses. Among them, measures of classification complexity can be used to estimate the difficulty in separating the data points into their expected classes. Descriptors of the spatial distribution of the data and estimates of the shape and size of the decision boundary are among the known measures for this characterization. This information can support the formulation of new data-driven pre-processing and pattern recognition techniques, which can in turn be focused on challenges highlighted by such characteristics of the problems. This article surveys and analyzes measures that can be extracted from the training datasets to characterize the complexity of the respective classification problems. Their use in recent literature is also reviewed and discussed, allowing to prospect opportunities for future work in the area. Finally, descriptions are given on an R package named Extended Complexity Library (ECoL) that implements a set of complexity measures and is made publicly available.<\/jats:p>","DOI":"10.1145\/3347711","type":"journal-article","created":{"date-parts":[[2019,9,13]],"date-time":"2019-09-13T08:28:56Z","timestamp":1568363336000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":257,"title":["How Complex Is Your Classification Problem?"],"prefix":"10.1145","volume":"52","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6140-571X","authenticated-orcid":false,"given":"Ana C.","family":"Lorena","sequence":"first","affiliation":[{"name":"Instituto Tecnol\u00f3gico de Aeron\u00e1utica, S\u00e3o Paulo, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lu\u00eds P. F.","family":"Garcia","sequence":"additional","affiliation":[{"name":"University of Brasilia, Bras\u00edlia, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jens","family":"Lehmann","sequence":"additional","affiliation":[{"name":"University of Bonn, Bonn, North Rhine-Westphalia, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcilio C. P.","family":"Souto","sequence":"additional","affiliation":[{"name":"University of Orl\u00e9ans, Orleans, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tin Kam","family":"Ho","sequence":"additional","affiliation":[{"name":"IBM Watson, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,9,13]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2004.12.002"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/3160262.3160266"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2015.07.028"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10044-014-0446-y"},{"key":"e_1_2_1_5_1","volume-title":"Ho","author":"Basu Mitra","year":"2006","unstructured":"Mitra Basu and Tin K . Ho . 2006 . Data Complexity in Pattern Recognition. Springer . Mitra Basu and Tin K. Ho. 2006. Data Complexity in Pattern Recognition. Springer."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007730.1007735"},{"key":"e_1_2_1_7_1","volume-title":"Data Complexity in Pattern Recognition","author":"Baumgartner Richard","unstructured":"Richard Baumgartner , Tin K. Ho , Ray Somorjai , Uwe Himmelreich , and Tania Sorrell . 2006. Complexity of magnetic resonance spectrum classification . In Data Complexity in Pattern Recognition . Springer , 241--248. Richard Baumgartner, Tin K. Ho, Ray Somorjai, Uwe Himmelreich, and Tania Sorrell. 2006. Complexity of magnetic resonance spectrum classification. In Data Complexity in Pattern Recognition. Springer, 241--248."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2004.840153"},{"key":"e_1_2_1_9_1","first-page":"301","article-title":"Support vector machine solvers","volume":"3","author":"Bottou L\u00e9on","year":"2007","unstructured":"L\u00e9on Bottou and Chih-Jen Lin . 2007 . Support vector machine solvers . Large Scale Kern. Mach. 3 , 1 (2007), 301 -- 320 . L\u00e9on Bottou and Chih-Jen Lin. 2007. Support vector machine solvers. Large Scale Kern. Mach. 3, 1 (2007), 301--320.","journal-title":"Large Scale Kern. Mach."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2014.05.003"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.10.038"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/03610927408827101"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 12th International Conference on Intelligent Systems Design and Applications (ISDA\u201912)","author":"Campos Yoisel","unstructured":"Yoisel Campos , Carlos Morell , and Francesc J. Ferri . 2012. A local complexity based combination method for decision forests trained with high-dimensional data . In Proceedings of the 12th International Conference on Intelligent Systems Design and Applications (ISDA\u201912) . 194--199. Yoisel Campos, Carlos Morell, and Francesc J. Ferri. 2012. A local complexity based combination method for decision forests trained with high-dimensional data. In Proceedings of the 12th International Conference on Intelligent Systems Design and Applications (ISDA\u201912). 194--199."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-32034-2_42"},{"key":"e_1_2_1_15_1","first-page":"63","article-title":"Impact of the characteristics of data sets on incremental learning","volume":"2","author":"Ciarelli Patrick M.","year":"2013","unstructured":"Patrick M. Ciarelli , Elias Oliveira , and Evandro O. T. Salles . 2013 . Impact of the characteristics of data sets on incremental learning . Artific. Intell. Res. 2 , 4 (2013), 63 -- 74 . Patrick M. Ciarelli, Elias Oliveira, and Evandro O. T. Salles. 2013. Impact of the characteristics of data sets on incremental learning. Artific. Intell. Res. 2, 4 (2013), 63--74.","journal-title":"Artific. Intell. Res."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03223-3_5"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511801389"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2017.02.010"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2017.09.010"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2014.12.003"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 17th International Conference on Image Processing Theory, Tools and Applications (IPTA\u201917)","author":"Cruz Rafael M. O.","unstructured":"Rafael M. O. Cruz , Hiba H. Zakane , Robert Sabourin , and George D. C. Cavalcanti . 2017b. Dynamic ensemble selection VS K-NN: Why and when dynamic selection obtains higher classification performance? In Proceedings of the 17th International Conference on Image Processing Theory, Tools and Applications (IPTA\u201917) . 1--6. Rafael M. O. Cruz, Hiba H. Zakane, Robert Sabourin, and George D. C. Cavalcanti. 2017b. Dynamic ensemble selection VS K-NN: Why and when dynamic selection obtains higher classification performance? In Proceedings of the 17th International Conference on Image Processing Theory, Tools and Applications (IPTA\u201917). 1--6."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23291-6_6"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851613.2851788"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201918)","author":"Vin\u00edcius","unstructured":"Vin\u00edcius V. de Melo and Ana C. Lorena. 2018. Using complexity measures to evolve synthetic classification datasets . In Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201918) . 1--8. Vin\u00edcius V. de Melo and Ana C. Lorena. 2018. Using complexity measures to evolve synthetic classification datasets. In Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201918). 1--8."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8655(02)00303-3"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.01.090"},{"key":"e_1_2_1_28_1","volume-title":"Learning from Imbalanced Data Sets","author":"Fern\u00e1ndez Alberto","unstructured":"Alberto Fern\u00e1ndez , Salvador Garc\u00eda , Mikel Galar , Ronaldo C. Prati , Bartosz Krawczyk , and Francisco Herrera . 2018. Learning from Imbalanced Data Sets . Springer . Alberto Fern\u00e1ndez, Salvador Garc\u00eda, Mikel Galar, Ronaldo C. Prati, Bartosz Krawczyk, and Francisco Herrera. 2018. Learning from Imbalanced Data Sets. Springer."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2013.10.007"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74141-1_9"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2013.2292894"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the 8th International Conference on Hybrid Artificial Intelligent Systems (HAIS\u201913)","author":"Garcia Lu\u00eds P. F.","unstructured":"Lu\u00eds P. F. Garcia , Andr\u00e9 C. P. L. F. de Carvalho , and Ana C. Lorena . 2013. Noisy data set identification . In Proceedings of the 8th International Conference on Hybrid Artificial Intelligent Systems (HAIS\u201913) . 629--638. Lu\u00eds P. F. Garcia, Andr\u00e9 C. P. L. F. de Carvalho, and Ana C. Lorena. 2013. Noisy data set identification. In Proceedings of the 8th International Conference on Hybrid Artificial Intelligent Systems (HAIS\u201913). 629--638."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2014.10.085"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2014.12.100"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2018.8545110"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecolmodel.2015.06.002"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-011-0462-9"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2011.12.011"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.2307\/2528823"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2008.239"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13042-015-0348-3"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/648054.746358"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/s100440200009"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.990132"},{"key":"e_1_2_1_45_1","volume-title":"Law","author":"Ho Tin K.","year":"2006","unstructured":"Tin K. Ho , Mitra Basu , and Martin H. C . Law . 2006 . Measures of geometrical complexity in classification problems. In Data Complexity in Pattern Recognition. Springer , 1--23. Tin K. Ho, Mitra Basu, and Martin H. C. Law. 2006. Measures of geometrical complexity in classification problems. In Data Complexity in Pattern Recognition. Springer, 1--23."},{"key":"e_1_2_1_46_1","volume-title":"Ho and Ester Bernad\u00f3-Mansilla","author":"Tin","year":"2006","unstructured":"Tin K. Ho and Ester Bernad\u00f3-Mansilla . 2006 . Classifier domains of competence in data complexity space. In Data Complexity in Pattern Recognition. Springer , 135--152. Tin K. Ho and Ester Bernad\u00f3-Mansilla. 2006. Classifier domains of competence in data complexity space. In Data Complexity in Pattern Recognition. Springer, 135--152."},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the 13th International Conference on Pattern Recognition (ICPR\u201996)","volume":"4","author":"Hoekstra Aarnoud","unstructured":"Aarnoud Hoekstra and Robert P. W. Duin . 1996. On the nonlinearity of pattern classifiers . In Proceedings of the 13th International Conference on Pattern Recognition (ICPR\u201996) , Vol. 4 . 271--275. Aarnoud Hoekstra and Robert P. W. Duin. 1996. On the nonlinearity of pattern classifiers. In Proceedings of the 13th International Conference on Pattern Recognition (ICPR\u201996), Vol. 4. 271--275."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2009.2024166"},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the 30th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS\u201908)","author":"Kamath Vidya","unstructured":"Vidya Kamath , Timothy J. Yeatman , and Steven A. Eschrich . 2008. Toward a measure of classification complexity in gene expression signatures . In Proceedings of the 30th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS\u201908) . 5704--5707. Vidya Kamath, Timothy J. Yeatman, and Steven A. Eschrich. 2008. Toward a measure of classification complexity in gene expression signatures. In Proceedings of the 30th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS\u201908). 5704--5707."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2009.04.019"},{"key":"e_1_2_1_51_1","volume-title":"Statistical Analysis of Network Data: Methods and Models","author":"Kolaczyk Eric D.","unstructured":"Eric D. Kolaczyk . 2009. Statistical Analysis of Network Data: Methods and Models . Springer . Eric D. Kolaczyk. 2009. Statistical Analysis of Network Data: Methods and Models. Springer."},{"key":"e_1_2_1_52_1","first-page":"47","article-title":"Discretization techniques: A recent survey","volume":"32","author":"Kotsiantis Sotiris","year":"2006","unstructured":"Sotiris Kotsiantis and Dimitris Kanellopoulos . 2006 . Discretization techniques: A recent survey . GESTS International Trans. Comput. Sci. Eng. 32 , 1 (2006), 47 -- 58 . Sotiris Kotsiantis and Dimitris Kanellopoulos. 2006. Discretization techniques: A recent survey. GESTS International Trans. Comput. Sci. Eng. 32, 1 (2006), 47--58.","journal-title":"GESTS International Trans. Comput. Sci. Eng."},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the 21st International Conference on Pattern Recognition (ICPR\u201912)","author":"Krijthe Jesse H.","year":"2012","unstructured":"Jesse H. Krijthe , Tin K. Ho , and Marco Loog . 2012 . Improving cross-validation based classifier selection using meta-learning . In Proceedings of the 21st International Conference on Pattern Recognition (ICPR\u201912) . 2873--2876. Jesse H. Krijthe, Tin K. Ho, and Marco Loog. 2012. Improving cross-validation based classifier selection using meta-learning. In Proceedings of the 21st International Conference on Pattern Recognition (ICPR\u201912). 2873--2876."},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the 13th International Conference on Pattern Recognition","volume":"4","author":"Lebourgeois Frank","year":"1996","unstructured":"Frank Lebourgeois and Hubert Emptoz . 1996 . Pretopological approach for supervised learning . In Proceedings of the 13th International Conference on Pattern Recognition , Vol. 4 . 256--260. Frank Lebourgeois and Hubert Emptoz. 1996. Pretopological approach for supervised learning. In Proceedings of the 13th International Conference on Pattern Recognition, Vol. 4. 256--260."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2014.2327034"},{"key":"e_1_2_1_56_1","first-page":"004","article-title":"Data Complexity in Machine Learning","volume":"2006","author":"Ling Li","year":"2006","unstructured":"Li Ling and Yaser S. Abu-Mostafa . 2006 . Data Complexity in Machine Learning . Technical Report CaltechCSTR : 2006 . 004 . California Institute of Technology. Li Ling and Yaser S. Abu-Mostafa. 2006. Data Complexity in Machine Learning. Technical Report CaltechCSTR:2006.004. California Institute of Technology.","journal-title":"Technical Report CaltechCSTR"},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the 4th International Workshop on Feature Selection in Data Mining (FSDM\u201910)","volume":"10","author":"Liu Huan","year":"2010","unstructured":"Huan Liu , Hiroshi Motoda , Rudy Setiono , and Zheng Zhao . 2010 . Feature selection: An ever evolving frontier in data mining . In Proceedings of the 4th International Workshop on Feature Selection in Data Mining (FSDM\u201910) , Vol. 10 . 4--13. Huan Liu, Hiroshi Motoda, Rudy Setiono, and Zheng Zhao. 2010. Feature selection: An ever evolving frontier in data mining. In Proceedings of the 4th International Workshop on Feature Selection in Data Mining (FSDM\u201910), Vol. 10. 4--13."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2011.12.043"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2011.03.054"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2010.03.027"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-009-9114-9"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-017-5681-1"},{"key":"e_1_2_1_63_1","volume-title":"Proceedings of the 10th Conference of the European Society for Fuzzy Logic and Technology (IWIFSGN\u201917)","author":"Lucca Giancarlo","year":"2017","unstructured":"Giancarlo Lucca , Jose Sanz , Gra\u00e7aliz P. Dimuro , Benjam\u00edn Bedregal , and Humberto Bustince . 2017 . Analyzing the behavior of aggregation and pre-aggregation functions in fuzzy rule-based classification systems with data complexity measures . In Proceedings of the 10th Conference of the European Society for Fuzzy Logic and Technology (IWIFSGN\u201917) . 443--455. Giancarlo Lucca, Jose Sanz, Gra\u00e7aliz P. Dimuro, Benjam\u00edn Bedregal, and Humberto Bustince. 2017. Analyzing the behavior of aggregation and pre-aggregation functions in fuzzy rule-based classification systems with data complexity measures. In Proceedings of the 10th Conference of the European Society for Fuzzy Logic and Technology (IWIFSGN\u201917). 443--455."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-013-0700-4"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2013.08.059"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2008.4761770"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2012.09.022"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/1830483.1830674"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/3477.938265"},{"key":"e_1_2_1_71_1","volume-title":"An Introduction to Kolmogorov Complexity and Its Applications","author":"Ming Li","unstructured":"Li Ming and Paul Vitanyi . 1993. An Introduction to Kolmogorov Complexity and Its Applications . Springer . Li Ming and Paul Vitanyi. 1993. An Introduction to Kolmogorov Complexity and Its Applications. Springer."},{"key":"e_1_2_1_72_1","volume-title":"Perceptrons: An Introduction to Computational Geometry","author":"Minsky Marvin","year":"1969","unstructured":"Marvin Minsky and Seymour Papert . 1969 . Perceptrons: An Introduction to Computational Geometry . The MIT Press, Cambridge , MA. Marvin Minsky and Seymour Papert. 1969. Perceptrons: An Introduction to Computational Geometry. The MIT Press, Cambridge, MA."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1007\/11492542_4"},{"key":"e_1_2_1_74_1","first-page":"31","article-title":"A meta-learning framework for pattern classification by means of data complexity measures","volume":"10","author":"Mollineda Ram\u00f3n A.","year":"2006","unstructured":"Ram\u00f3n A. Mollineda , Jos\u00e9 S. S\u00e1nchez , and Jos\u00e9 M. Sotoca . 2006 . A meta-learning framework for pattern classification by means of data complexity measures . Intel. Artific. 10 , 29 (2006), 31 -- 38 . Ram\u00f3n A. Mollineda, Jos\u00e9 S. S\u00e1nchez, and Jos\u00e9 M. Sotoca. 2006. A meta-learning framework for pattern classification by means of data complexity measures. Intel. Artific. 10, 29 (2006), 31--38.","journal-title":"Intel. Artific."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/BRACIS.2013.11"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-016-1003-3"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13748-017-0126-4"},{"key":"e_1_2_1_78_1","volume-title":"A note on the separability index. Retrieved from: Arxiv Preprint Arxiv:0812.1107","author":"Mthembu Linda","year":"2008","unstructured":"Linda Mthembu and Tshilidzi Marwala . 2008. A note on the separability index. Retrieved from: Arxiv Preprint Arxiv:0812.1107 ( 2008 ). Linda Mthembu and Tshilidzi Marwala. 2008. A note on the separability index. Retrieved from: Arxiv Preprint Arxiv:0812.1107 (2008)."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-017-5629-5"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/FUZZY.2011.6007739"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/BRACIS.2017.66"},{"key":"e_1_2_1_82_1","volume-title":"Ho","author":"Orriols-Puig Albert","year":"2010","unstructured":"Albert Orriols-Puig , N\u00faria Maci\u00e0 , and Tin K . Ho . 2010 . Documentation for the Data Complexity Library in C++. Technical Report. La Salle, Universitat Ramon Llull . Albert Orriols-Puig, N\u00faria Maci\u00e0, and Tin K. Ho. 2010. Documentation for the Data Complexity Library in C++. Technical Report. La Salle, Universitat Ramon Llull."},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.01.013"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2006.365"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2018.01.013"},{"key":"e_1_2_1_86_1","volume-title":"Proceedings of the 24th International Conference on Tools with Artificial Intelligence (ICTAI\u201912)","volume":"1","author":"Cavalcantiand George D. C.","unstructured":"George D. C. Cavalcantiand Tsang I . Ren and Breno A. Vale. 2012. Data complexity measures and nearest neighbor classifiers: A practical analysis for meta-learning . In Proceedings of the 24th International Conference on Tools with Artificial Intelligence (ICTAI\u201912) , Vol. 1 . 1065--1069. George D. C. Cavalcantiand Tsang I. Ren and Breno A. Vale. 2012. Data complexity measures and nearest neighbor classifiers: A practical analysis for meta-learning. In Proceedings of the 24th International Conference on Tools with Artificial Intelligence (ICTAI\u201912), Vol. 1. 1065--1069."},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2016.08.013"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2012.07.009"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2018.2866730"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2018.02.007"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1109\/PHM-Chongqing.2018.00224"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2003.1251146"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10044-002-0186-2"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICTAI.2011.171"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.1968.229395"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-013-5422-z"},{"key":"e_1_2_1_97_1","volume-title":"An easy to use repository for comparing and improving machine learning algorithm usage. Arxiv Preprint Arxiv:1405.7292","author":"Smith Michael R.","year":"2014","unstructured":"Michael R. Smith , Andrew White , Christophe Giraud-Carrier , and Tony Martinez . 2014b. An easy to use repository for comparing and improving machine learning algorithm usage. Arxiv Preprint Arxiv:1405.7292 ( 2014 ). Michael R. Smith, Andrew White, Christophe Giraud-Carrier, and Tony Martinez. 2014b. An easy to use repository for comparing and improving machine learning algorithm usage. Arxiv Preprint Arxiv:1405.7292 (2014)."},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1145\/1456650.1456656"},{"key":"e_1_2_1_99_1","volume-title":"Mollineda","author":"Sotoca Jos\u00e9 M.","year":"2005","unstructured":"Jos\u00e9 M. Sotoca , Jos\u00e9 S\u00e1nchez , and Ram\u00f3n A . Mollineda . 2005 . A review of data complexity measures and their applicability to pattern classification problems. In Actas Del III Taller Nacional de Miner\u00eda de Dados y Aprendizaje (TAMIDA\u2019 05). 77--83. Jos\u00e9 M. Sotoca, Jos\u00e9 S\u00e1nchez, and Ram\u00f3n A. Mollineda. 2005. A review of data complexity measures and their applicability to pattern classification problems. In Actas Del III Taller Nacional de Miner\u00eda de Dados y Aprendizaje (TAMIDA\u201905). 77--83."},{"key":"e_1_2_1_100_1","volume-title":"Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201910)","author":"Souto Marcilio C. P.","unstructured":"Marcilio C. P. Souto , Ana C. Lorena , Newton Spola\u00f4r , and Ivan G. Costa . 2010. Complexity measures of supervised classification tasks: A case study for cancer gene expression data . In Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201910) . 1352--1358. Marcilio C. P. Souto, Ana C. Lorena, Newton Spola\u00f4r, and Ivan G. Costa. 2010. Complexity measures of supervised classification tasks: A case study for cancer gene expression data. In Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201910). 1352--1358."},{"key":"e_1_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2019.01.047"},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-17508-4_9"},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1145\/2001576.2001759"},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1019956318069"},{"key":"e_1_2_1_105_1","volume-title":"Proceedings of the 7th International Conference on Computing and Convergence Technology (ICCCT\u201912)","author":"Vorraboot Piyanoot","year":"2012","unstructured":"Piyanoot Vorraboot , Suwanna Rasmequan , Chidchanok Lursinsap , and Krisana Chinnasarn . 2012 . A modified error function for imbalanced dataset classification problem . In Proceedings of the 7th International Conference on Computing and Convergence Technology (ICCCT\u201912) . 854--859. Piyanoot Vorraboot, Suwanna Rasmequan, Chidchanok Lursinsap, and Krisana Chinnasarn. 2012. A modified error function for imbalanced dataset classification problem. In Proceedings of the 7th International Conference on Computing and Convergence Technology (ICCCT\u201912). 854--859."},{"key":"e_1_2_1_106_1","volume-title":"Proceedings of the 18th Symposium of the Pattern Recognition Association of South Africa (PRASA\u201907)","author":"Christiaan V.","unstructured":"Christiaan V. D. Walt and Etienne Barnard. 2007. Measures for the characterisation of pattern-recognition data sets . In Proceedings of the 18th Symposium of the Pattern Recognition Association of South Africa (PRASA\u201907) . Christiaan V. D. Walt and Etienne Barnard. 2007. Measures for the characterisation of pattern-recognition data sets. In Proceedings of the 18th Symposium of the Pattern Recognition Association of South Africa (PRASA\u201907)."},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622767.1622768"},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1996.8.7.1341"},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38466-0_22"},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amc.2018.12.020"},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13042-016-0615-y"},{"key":"e_1_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.76"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3347711","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3347711","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:22:57Z","timestamp":1750188177000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3347711"}},"subtitle":["A Survey on Measuring Classification Complexity"],"short-title":[],"issued":{"date-parts":[[2019,9,13]]},"references-count":110,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2020,9,30]]}},"alternative-id":["10.1145\/3347711"],"URL":"https:\/\/doi.org\/10.1145\/3347711","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,9,13]]},"assertion":[{"value":"2017-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-09-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}