{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T19:20:12Z","timestamp":1778959212013,"version":"3.51.4"},"reference-count":119,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2020,9,30]],"date-time":"2020-09-30T00:00:00Z","timestamp":1601424000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012190","name":"Ministry of Science and Higher Education of the Russian Federation","doi-asserted-by":"publisher","award":["14.Y26.31.0022"],"award-info":[{"award-number":["14.Y26.31.0022"]}],"id":[{"id":"10.13039\/501100012190","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The curse of dimensionality causes the well-known and widely discussed problems for machine learning methods. There is a hypothesis that using the Manhattan distance and even fractional lp quasinorms (for p less than 1) can help to overcome the curse of dimensionality in classification problems. In this study, we systematically test this hypothesis. It is illustrated that fractional quasinorms have a greater relative contrast and coefficient of variation than the Euclidean norm l2, but it is shown that this difference decays with increasing space dimension. It has been demonstrated that the concentration of distances shows qualitatively the same behaviour for all tested norms and quasinorms. It is shown that a greater relative contrast does not mean a better classification quality. It was revealed that for different databases the best (worst) performance was achieved under different norms (quasinorms). A systematic comparison shows that the difference in the performance of kNN classifiers for lp at p = 0.5, 1, and 2 is statistically insignificant. Analysis of curse and blessing of dimensionality requires careful definition of data dimensionality that rarely coincides with the number of attributes. We systematically examined several intrinsic dimensions of the data.<\/jats:p>","DOI":"10.3390\/e22101105","type":"journal-article","created":{"date-parts":[[2020,9,30]],"date-time":"2020-09-30T09:41:01Z","timestamp":1601458861000},"page":"1105","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":46,"title":["Fractional Norms and Quasinorms Do Not Help to Overcome the Curse of Dimensionality"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1474-1734","authenticated-orcid":false,"given":"Evgeny M.","family":"Mirkes","sequence":"first","affiliation":[{"name":"School of Mathematics and Actuarial Science, University of Leicester, Leicester LE1 7HR, UK"},{"name":"Laboratory of Advanced Methods for High-Dimensional Data Analysis, Lobachevsky State University, 603105 Nizhny Novgorod, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3439-1500","authenticated-orcid":false,"given":"Jeza","family":"Allohibi","sequence":"additional","affiliation":[{"name":"School of Mathematics and Actuarial Science, University of Leicester, Leicester LE1 7HR, UK"},{"name":"Department of Mathematics, Taibah University, Janadah Bin Umayyah Road, Tayba, Medina 42353, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6224-1430","authenticated-orcid":false,"given":"Alexander","family":"Gorban","sequence":"additional","affiliation":[{"name":"School of Mathematics and Actuarial Science, University of Leicester, Leicester LE1 7HR, UK"},{"name":"Laboratory of Advanced Methods for High-Dimensional Data Analysis, Lobachevsky State University, 603105 Nizhny Novgorod, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Bellman, R.E. (1961). Adaptive Control Processes: A Guided Tour, Princeton University Press.","DOI":"10.1515\/9781400874668"},{"key":"ref_2","unstructured":"Bishop, C.M. (2006). The curse of dimensionality. Pattern Recognition and Machine Learning, Springer."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Hastie, T., Tibshirani, R., and Friedman, J.H. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer.","DOI":"10.1007\/978-0-387-84858-7"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1109\/69.908983","article-title":"On the \u201cdimensionality curse\u201d and the \u201cself-similarity blessing\u201d","volume":"13","author":"Korn","year":"2001","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bishop, C.M. (1995). Neural Networks for Pattern Recognition, Oxford University Press.","DOI":"10.1093\/oso\/9780198538493.001.0001"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.plrev.2018.09.005","article-title":"The unreasonable effectiveness of small neural ensembles in high-dimensional brain","volume":"29","author":"Gorban","year":"2019","journal-title":"Phys. Life Rev."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1016\/j.neunet.2007.09.017","article-title":"Generalized multiscale radial basis function networks","volume":"20","author":"Billings","year":"2007","journal-title":"Neural Netw."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.ijar.2019.01.008","article-title":"Design methodology for radial basis function neural networks classifier based on locally linear reconstruction and conditional fuzzy C-means clustering","volume":"106","author":"Roh","year":"2019","journal-title":"Int. J. Approx. Reason."},{"key":"ref_9","unstructured":"Awan, I., Younas, M., \u00dcnal, P., and Aleksy, M. (2019). Committee of the Combined RBF-SGTM Neural-Like Structures for Prediction Tasks. Mobile Web and Intelligent Information Systems, Springer International Publishing."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Izonin, I., Tkachenko, R., Kryvinska, N., Gregus, M., Tkachenko, P., and Vitynskyi, P. (2019, January 2\u20136). Committee of SGTM Neural-Like Structures with RBF kernel for Insurance Cost Prediction Task. Proceedings of the 2019 IEEE 2nd Ukraine Conference on Electrical and Computer Engineering (UKRCON), Lviv, Ukraine.","DOI":"10.1109\/UKRCON.2019.8879905"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Beyer, K., Goldstein, J., Ramakrishnan, R., and Shaft, U. (1999). When is \u201cnearest neighbor\u201d meaningful?. International Conference on Database Theory, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/3-540-49257-7_15"},{"key":"ref_12","unstructured":"Hinneburg, A., Aggarwal, C.C., and Keim, D.A. (2000, January 10\u201314). What is the nearest neighbor in high dimensional spaces?. Proceedings of the 26th International Conference on Very Large Databases, Cairo, Egypt. Available online: https:\/\/kops.uni-konstanz.de\/bitstream\/handle\/123456789\/5849\/P506.pdf."},{"key":"ref_13","first-page":"2487","article-title":"Hubs in space: Popular nearest neighbors in high-dimensional data","volume":"11","author":"Nanopoulos","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Aggarwal, C.C., Hinneburg, A., and Keim, D.A. (2001). On the surprising behavior of distance metrics in high dimensional space. International Conference on Database Theory, Springer.","DOI":"10.1007\/3-540-44503-X_27"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Aggarwal, C.C., and Yu, P.S. (2001). Outlier Detection for High Dimensional Data. Proceedings of the 2001 ACM SIGMOD International Conference on Management of Data, Association for Computing Machinery.","DOI":"10.1145\/375663.375668"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kainen, P.C. (1997). Utilizing geometric anomalies of high dimension: When complexity makes computation easier. Computer Intensive Methods in Control and Signal Processing, Birkh\u00e4user.","DOI":"10.1007\/978-1-4612-1996-5_18"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chen, D., Cao, X., Wen, F., and Sun, J. (2013, January 23\u201328). Blessing of Dimensionality: High-Dimensional Feature and Its Efficient Compression for Face Verification. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.389"},{"key":"ref_18","first-page":"64","article-title":"The blessing of dimensionality: Separation theorems in the thermodynamic limit","volume":"49","author":"Gorban","year":"2016","journal-title":"IFAC Pap."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1109\/TPAMI.2016.2539946","article-title":"Blessing of dimensionality: Recovering mixture data via dictionary pursuit","volume":"39","author":"Liu","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Vershynin, R. (2018). High-Dimensional Probability: An Introduction with Applications in Data Science, Cambridge University Press.","DOI":"10.1017\/9781108231596"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gorban, A.N., Makarov, V.A., and Tyukin, I.Y. (2020). High-dimensional brain in a high-dimensional world: Blessing of dimensionality. Entropy, 22.","DOI":"10.3390\/e22010082"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1007\/s000390300004","article-title":"Isoperimetry of waists and concentration of maps","volume":"13","author":"Gromov","year":"2003","journal-title":"Geom. Funct. Anal."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1006\/aima.2000.1949","article-title":"Concentration Property on Probability Spaces","volume":"156","author":"Giannopoulos","year":"2000","journal-title":"Adv. Math."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"20170237","DOI":"10.1098\/rsta.2017.0237","article-title":"Blessing of dimensionality: Mathematical foundations of the statistical physics of data","volume":"376","author":"Gorban","year":"2018","journal-title":"Philos. Trans. R. Soc. A"},{"key":"ref_25","unstructured":"Ledoux, M. (2001). The Concentration of Measure Phenomenon, American Mathematical Society."},{"key":"ref_26","unstructured":"Donoho, D.L. (2000, January 6\u201312). High-dimensional data analysis: The curses and blessings of dimensionality. Proceedings of the AMS Conference on Math Challenges of the 21st Century, Los Angeles, CA, USA. Available online: https:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.329.3392&rep=rep1&type=pdf."},{"key":"ref_27","first-page":"1135","article-title":"The more, the merrier: The blessing of dimensionality for learning large Gaussian mixtures","volume":"35","author":"Anderson","year":"2014","journal-title":"J. Mach. Learn. Res. Workshop Conf. Proc."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/j.ins.2018.07.040","article-title":"Correction of AI systems by linear discriminants: Probabilistic foundations","volume":"466","author":"Gorban","year":"2018","journal-title":"Inform. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/j.neunet.2017.07.014","article-title":"Stochastic separation theorems","volume":"94","author":"Gorban","year":"2017","journal-title":"Neural Netw."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Tyukin, I.Y., Higham, D.J., and Gorban, A.N. (2020). On Adversarial Examples and Stealth Attacks in Artificial Intelligence Systems. arXiv.","DOI":"10.1109\/IJCNN48605.2020.9207472"},{"key":"ref_31","unstructured":"Brown, A., and Pearcy, C. (2012). Introduction to Operator Theory I: Elements of Functional Analysis, Springer."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1080\/14786440109462720","article-title":"LIII. On lines and planes of closest fit to systems of points in space","volume":"2","author":"Pearson","year":"1901","journal-title":"Lond. Edinb. Dublin Philos. Mag. J. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Jobson, J.D. (1992). Applied Multivariate Data Analysis: Volume II: Categorical and Multivariate Methods, Springer.","DOI":"10.1007\/978-1-4612-0921-8"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1007\/BF02289162","article-title":"Some necessary conditions for common-factor analysis","volume":"19","author":"Guttman","year":"1954","journal-title":"Psychometrika"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1177\/001316446002000116","article-title":"The application of electronic computers to factor analysis","volume":"20","author":"Kaiser","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2204","DOI":"10.2307\/1939574","article-title":"Stopping rules in principal components analysis: A comparison of heuristical and statistical approaches","volume":"74","author":"Jackson","year":"1993","journal-title":"Ecology"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1109\/T-C.1971.223208","article-title":"An algorithm for finding intrinsic dimensionality of data","volume":"C-20","author":"Fukunaga","year":"1971","journal-title":"IEEE Trans. Comput."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Albergante, L., Bac, J., and Zinovyev, A. (2019, January 14\u201319). Estimating the effective dimension of large biological datasets using Fisher separability analysis. Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.","DOI":"10.1109\/IJCNN.2019.8852450"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Vicsek, T. (1992). Fractal Growth Phenomena, World Scientific Publishing.","DOI":"10.1142\/1407"},{"key":"ref_40","unstructured":"K\u00f6the, G. (1969). Topological Vector Spaces. Translated by DJH Garling, Springer."},{"key":"ref_41","unstructured":"Fran\u00e7ois, D., Wertz, V., and Verleysen, M. (2005, January 27\u201329). Non-Euclidean Metrics for Similarity Search in Noisy Datasets. Proceedings of the ESANN, Bruges, Belgium. Available online: https:\/\/www.elen.ucl.ac.be\/Proceedings\/esann\/esannpdf\/es2005-116.pdf."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1109\/TKDE.2007.1037","article-title":"The concentration of fractional distances","volume":"19","author":"Francois","year":"2007","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_43","first-page":"1490","article-title":"Fractional Metrics for Fuzzy c-Means","volume":"3","author":"Dik","year":"2014","journal-title":"Int. J. Comput. Infor. Tech."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Jayaram, B., and Klawonn, F. (2012). Can unbounded distance measures mitigate the curse of dimensionality?. Int. J. Data Min. Model. Manag., 4.","DOI":"10.1504\/IJDMMM.2012.049883"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.ins.2011.07.048","article-title":"Distance metrics for high dimensional nearest neighborhood recovery: Compression and normalization","volume":"184","author":"France","year":"2012","journal-title":"Inform. Sci."},{"key":"ref_46","unstructured":"Doherty, K.A.J., Adams, R.G., and Davey, N. (2004, January 28\u201330). Non-Euclidean norms and data normalisation. Proceedings of the ESANN 2004, Bruges, Belgium. Available online: https:\/\/www.elen.ucl.ac.be\/Proceedings\/esann\/esannpdf\/es2004-65.pdf."},{"key":"ref_47","unstructured":"Cormode, G., Indyk, P., Koudas, N., and Muthukrishnan, S. (March, January 26). Fast mining of massive tabular data via approximate distance computations. Proceedings of the 18th International Conference on Data Engineering, San Jose, CA, USA."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Datar, M., Immorlica, N., Indyk, P., and Mirrokni, V.S. (2004). Locality-sensitive hashing scheme based on p-stable distributions. Proceedings of the Twentieth Annual Symposium on Computational Geometry\u2014SCG \u201904, ACM Press.","DOI":"10.1145\/997817.997857"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Gorban, A.N., Mirkes, E.M., and Zinovyev, A. (2018, January 8\u201313). Data analysis with arbitrary error measures approximated by piece-wise quadratic PQSQ functions. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio, Brazil.","DOI":"10.1109\/IJCNN.2018.8489568"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1093\/cercor\/bhs352","article-title":"Tracking Whole-Brain Connectivity Dynamics in the Resting State","volume":"24","author":"Allen","year":"2014","journal-title":"Cereb. Cortex"},{"key":"ref_51","unstructured":"Elkan, C. (2003, January 21\u201324). Using the triangle inequality to accelerate k-means. Proceedings of the 20th International Conference on Machine Learning (ICML-03), Washington, DC, USA. Available online: https:\/\/www.aaai.org\/Papers\/ICML\/2003\/ICML03-022.pdf."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/TCSVT.2002.808079","article-title":"CBSA: Content-based soft annotation for multimodal image retrieval using Bayes point machines","volume":"13","author":"Chang","year":"2003","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_53","unstructured":"Demartines, P. (1994). Analyse de Donn\u00e9es Par R\u00e9seaux de Neurones Auto-Organis\u00e9s. [Ph.D. Thesis, Grenoble INPG]. (In French)."},{"key":"ref_54","unstructured":"Yianilos, P.N. (1999). Excluded middle vantage point forests for nearest neighbor search. DIMACS Implementation Challenge, ALENEX\u201999, Citeseer. Available online: http:\/\/pnylab.com\/papers\/vp2\/vp2.pdf."},{"key":"ref_55","first-page":"13","article-title":"K-means with Three different Distance Metrics","volume":"67","author":"Singh","year":"2013","journal-title":"Int. J. Comput. Appl."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1186\/s40064-016-2941-7","article-title":"The distance function effect on k-nearest neighbor classification for medical datasets","volume":"5","author":"Hu","year":"2016","journal-title":"SpringerPlus"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1016\/j.camwa.2012.09.011","article-title":"Is thek-NN classifier in high dimensions affected by the curse of dimensionality?","volume":"65","author":"Pestov","year":"2013","journal-title":"Comput. Math. Appl."},{"key":"ref_58","unstructured":"Gorban, A.N., Allohibi, J., and Mirkes, E.M. (2020, July 11). Databases and Code for lp Functional Comparison. Available online: https:\/\/github.com\/Mirkes\/Databases-and-code-for-l%5Fp-functional-comparison."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Mirkes, E.M., Allohibi, J., and Gorban, A.N. (2019, January 14\u201319). Do Fractional Norms and Quasinorms Help to Overcome the Curse of Dimensionality?. Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.","DOI":"10.1109\/IJCNN.2019.8851899"},{"key":"ref_60","first-page":"2","article-title":"Determining the number of factors to retain in EFA: An easy-to-use computer program for carrying out parallel analysis","volume":"12","author":"Ledesma","year":"2007","journal-title":"Pract. Assess. Res. Eval."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/1745-6150-2-2","article-title":"Component retention in principal component analysis with application to cDNA microarray data","volume":"2","author":"Cangelosi","year":"2007","journal-title":"Biol. Direct"},{"key":"ref_62","unstructured":"Belsley, D.A., Kuh, E., and Welsch, R.E. (2005). Regression Diagnostics: Identifying Influential Data and Sources of Collinearity, John Wiley & Sons."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Gorban, A.N., K\u00e9gl, B., Wunsch II, D.C., and Zinovyev, A.Y. (2008). Principal Manifolds for Data Visualization and Dimension Reduction, Springer. Lecture Notes in Computational Science and Engineering.","DOI":"10.1007\/978-3-540-73750-6"},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1016\/j.aml.2006.04.022","article-title":"Topological grammars for data approximation","volume":"20","author":"Gorban","year":"2007","journal-title":"Appl. Math. Lett."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1142\/S0129065710002383","article-title":"Principal manifolds and graphs in practice: From molecular biology to dynamical systems","volume":"20","author":"Gorban","year":"2010","journal-title":"Int. J. Neural Syst."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"1471","DOI":"10.1016\/j.camwa.2012.12.009","article-title":"Data complexity measured by principal graphs","volume":"65","author":"Zinovyev","year":"2013","journal-title":"Comput. Math. Appl."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1090\/S0273-0979-09-01249-X","article-title":"Topology and data","volume":"46","author":"Carlsson","year":"2009","journal-title":"Bull. Amer. Math. Soc."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"110","DOI":"10.3389\/fnbot.2019.00110","article-title":"Lizard brain: Tackling locally low-dimensional yet globally complex organization of multi-dimensional datasets","volume":"13","author":"Bac","year":"2020","journal-title":"Front. Neurorobot."},{"key":"ref_69","unstructured":"Albergante, L., Zinovyev, A., and Bac, J. (2020, July 11). Data Point Cloud Separability Analysis Based on Linear Fisher Discriminants. Available online: https:\/\/github.com\/auranic\/FisherSeparabilityAnalysis\/tree\/master\/MATLAB."},{"key":"ref_70","unstructured":"You, K. (2020, July 11). Package Rdimtools. Available online: https:\/\/cran.rstudio.com\/web\/packages\/Rdimtools\/Rdimtools.pdf."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.neunet.2019.05.003","article-title":"Understanding autoencoders with information theoretic concepts","volume":"117","author":"Yu","year":"2019","journal-title":"Neural Netw."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Sammut, C., and Webb, G.I. (2011). Encyclopedia of Machine Learning, Springer.","DOI":"10.1007\/978-0-387-30164-8"},{"key":"ref_73","unstructured":"Dheeru, D., and Taniskidou, E.K. (2020, July 11). UCI Machine Learning Repository. Available online: http:\/\/archive.ics.uci.edu\/ml."},{"key":"ref_74","unstructured":"Blood Transfusion Service Center (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Blood+Transfusion+Service+Center."},{"key":"ref_75","unstructured":"Banknote Authentication (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/banknote+authentication."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/j.compbiomed.2017.01.001","article-title":"An expert system for selecting wart treatment method","volume":"81","author":"Khozeimeh","year":"2017","journal-title":"Comput. Biol. Med."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1111\/ijd.13535","article-title":"Intralesional immunotherapy compared to cryotherapy in the treatment of warts","volume":"56","author":"Khozeimeh","year":"2017","journal-title":"Int. J. Dermatol."},{"key":"ref_78","unstructured":"Cryotherapy (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Cryotherapy+Dataset+."},{"key":"ref_79","unstructured":"Vertebral Column (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Vertebral+Column."},{"key":"ref_80","unstructured":"Immunotherapy (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Immunotherapy+Dataset."},{"key":"ref_81","unstructured":"HTRU2 (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/HTRU2."},{"key":"ref_82","unstructured":"Lyon, R.J. (2020, September 29). HTRU2. Available online: https:\/\/figshare.com\/articles\/dataset\/HTRU2\/3080389\/1."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.1093\/mnras\/stw656","article-title":"Fifty years of pulsar candidate selection: From simple filters to a new principled real-time classification approach","volume":"459","author":"Lyon","year":"2016","journal-title":"Mon. Not. R. Astron. Soc."},{"key":"ref_84","unstructured":"Indian Liver Patient (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/ILPD+%28Indian+Liver+Patient+Dataset%29."},{"key":"ref_85","unstructured":"Bhatt, R. (2020, July 11). Planning-Relax Dataset for Automatic Classification of EEG Signals. UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Planning+Relax."},{"key":"ref_86","unstructured":"MAGIC Gamma Telescope (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/MAGIC+Gamma+Telescope."},{"key":"ref_87","unstructured":"EEG Eye State (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/EEG+Eye+State#."},{"key":"ref_88","unstructured":"Climate Model Simulation Crashes (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Climate+Model+Simulation+Crashes."},{"key":"ref_89","unstructured":"Diabetic Retinopathy Debrecen Data Set (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Diabetic+Retinopathy+Debrecen+Data+Set."},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.knosys.2013.12.023","article-title":"An ensemble-based system for automatic screening of diabetic retinopathy","volume":"60","author":"Antal","year":"2014","journal-title":"Knowl. Based Syst."},{"key":"ref_91","unstructured":"SPECTF Heart (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/SPECTF+Heart."},{"key":"ref_92","unstructured":"Breast Cancer Wisconsin (Diagnostic) (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Breast+Cancer+Wisconsin+%28Diagnostic%29."},{"key":"ref_93","unstructured":"Ionosphere (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Ionosphere."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"867","DOI":"10.1021\/ci4000213","article-title":"Quantitative structure\u2013activity relationship models for ready biodegradability of chemicals","volume":"53","author":"Mansouri","year":"2013","journal-title":"J. Chem. Inf. Model."},{"key":"ref_95","unstructured":"QSAR biodegradation (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/QSAR+biodegradation."},{"key":"ref_96","unstructured":"MiniBooNE particle identification (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/MiniBooNE+particle+identification."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1007\/s10817-014-9301-5","article-title":"Machine learning for first-order theorem proving","volume":"53","author":"Bridge","year":"2014","journal-title":"J. Autom. Reason."},{"key":"ref_98","unstructured":"First-order Theorem Proving (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/First-order+theorem+proving."},{"key":"ref_99","unstructured":"Connectionist Bench (Sonar Mines vs. Rocks) (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/connectionist+bench+%28sonar,+mines+vs%2E+rocks%29."},{"key":"ref_100","unstructured":"(2020, July 11). Quality Assessment of Digital Colposcopies. UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Quality+Assessment+of+Digital+Colposcopies."},{"key":"ref_101","doi-asserted-by":"crossref","unstructured":"Fernandes, K., Cardoso, J.S., and Fernandes, J. (2017). Transfer learning with partial observability applied to cervical cancer screening. Iberian Conference on Pattern Recognition and Image Analysis, Springer International Publishing.","DOI":"10.1007\/978-3-319-58838-4_27"},{"key":"ref_102","unstructured":"Huang, G.B., Ramesh, M., Berg, T., and Learned-Miller, E. (2007). Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments, University of Massachusetts. Available online: http:\/\/vis-www.cs.umass.edu\/lfw\/lfw.pdf."},{"key":"ref_103","unstructured":"(2020, July 11). Musk 1 and 2. UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Musk+(Version+1)."},{"key":"ref_104","unstructured":"Saul, L.K., Weiss, Y., and Bottou, L. (2005). Result analysis of the NIPS 2003 feature selection challenge. Advances in Neural Information Processing Systems 17, MIT Press. Available online: http:\/\/papers.nips.cc\/paper\/2728-result-analysis-of-the-nips-2003-feature-selection-challenge.pdf."},{"key":"ref_105","unstructured":"Madelon (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Madelon."},{"key":"ref_106","unstructured":"Gisette (2020, July 11). UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Gisette."},{"key":"ref_107","first-page":"1","article-title":"Statistical comparisons of classifiers over multiple data sets","volume":"7","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1214\/aoms\/1177731944","article-title":"A comparison of alternative tests of significance for the problem of m rankings","volume":"11","author":"Friedman","year":"1940","journal-title":"Ann. Math. Stat."},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1080\/01621459.1937.10503522","article-title":"The use of ranks to avoid the assumption of normality implicit in the analysis of variance","volume":"32","author":"Friedman","year":"1937","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_110","first-page":"263","article-title":"Distribution-free multiple comparisons","volume":"18","author":"Nemenyi","year":"1962","journal-title":"Biometrics"},{"key":"ref_111","unstructured":"Altman, D., Machin, D., Bryant, T., and Gardner, M. (2013). Statistics with Confidence: Confidence Intervals and Statistical Guidelines, John Wiley & Sons. [2nd ed.]."},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"2282","DOI":"10.1007\/s11999-008-0346-9","article-title":"Statistics in brief: The importance of sample size in the planning and interpretation of medical research","volume":"466","author":"Biau","year":"2008","journal-title":"Clin. Orthop. Relat. R."},{"key":"ref_113","doi-asserted-by":"crossref","first-page":"55","DOI":"10.4103\/0974-7788.59946","article-title":"Sample size calculation","volume":"1","author":"Kadam","year":"2010","journal-title":"Int. J. Ayurveda Res."},{"key":"ref_114","unstructured":"Bonferroni, C.E. (1935). Il calcolo delle assicurazioni su gruppi di teste. Studi in Onore del Professore Salvatore Ortu Carboni, Tip. del Senato. (In Italian)."},{"key":"ref_115","doi-asserted-by":"crossref","first-page":"80","DOI":"10.2307\/3001968","article-title":"Individual comparisons by ranking methods","volume":"1","author":"Wilcoxon","year":"1945","journal-title":"Biom. Bull."},{"key":"ref_116","unstructured":"(2020, July 11). Wilcoxon Signed Rank Test. Available online: https:\/\/www.mathworks.com\/help\/stats\/signrank.html."},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/BF02699376","article-title":"Concentration of measure and isoperimetric inequalities in product spaces","volume":"81","author":"Talagrand","year":"1995","journal-title":"Publ. Math."},{"key":"ref_118","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1007\/s00039-011-0136-5","article-title":"Interpolating thin-shell and sharp large-deviation estimates for isotropic log-concave measures","volume":"21","author":"Milman","year":"2011","journal-title":"Geom. Funct. Anal."},{"key":"ref_119","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J. R. Stat. Soc. B"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/10\/1105\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:15:17Z","timestamp":1760177717000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/10\/1105"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,30]]},"references-count":119,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["e22101105"],"URL":"https:\/\/doi.org\/10.3390\/e22101105","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,30]]}}}