{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T13:36:29Z","timestamp":1771076189341,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2022,4,15]],"date-time":"2022-04-15T00:00:00Z","timestamp":1649980800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Dimensionality reduction techniques are often used by researchers in order to make high dimensional data easier to interpret visually, as data visualization is only possible in low dimensional spaces. Recent research in nonlinear dimensionality reduction introduced many effective algorithms, including t-distributed stochastic neighbor embedding (t-SNE), uniform manifold approximation and projection (UMAP), dimensionality reduction technique based on triplet constraints (TriMAP), and pairwise controlled manifold approximation (PaCMAP), aimed to preserve both the local and global structure of high dimensional data while reducing the dimensionality. The UMAP algorithm has found its application in bioinformatics, genetics, genomics, and has been widely used to improve the accuracy of other machine learning algorithms. In this research, we compare the performance of different fuzzy information discrimination measures used as loss functions in the UMAP algorithm while constructing low dimensional embeddings. In order to achieve this, we derive the gradients of the considered losses analytically and employ the Adam algorithm during the loss function optimization process. From the conducted experimental studies we conclude that the use of either the logarithmic fuzzy cross entropy loss without reduced repulsion or the symmetric logarithmic fuzzy cross entropy loss with sufficiently large neighbor count leads to better global structure preservation of the original multidimensional data when compared to the loss function used in the original UMAP algorithm implementation.<\/jats:p>","DOI":"10.3390\/jimaging8040113","type":"journal-article","created":{"date-parts":[[2022,4,18]],"date-time":"2022-04-18T04:21:28Z","timestamp":1650255688000},"page":"113","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Fuzzy Information Discrimination Measures and Their Application to Low Dimensional Embedding Construction in the UMAP Algorithm"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4516-3746","authenticated-orcid":false,"given":"Liliya A.","family":"Demidova","sequence":"first","affiliation":[{"name":"Institute of Information Technologies, Federal State Budget Educational Institution of Higher Education \u201cMIREA\u2013Russian Technological University\u201d, 78, Vernadsky Avenue, 119454 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1977-8165","authenticated-orcid":false,"given":"Artyom V.","family":"Gorchakov","sequence":"additional","affiliation":[{"name":"Institute of Information Technologies, Federal State Budget Educational Institution of Higher Education \u201cMIREA\u2013Russian Technological University\u201d, 78, Vernadsky Avenue, 119454 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,4,15]]},"reference":[{"key":"ref_1","first-page":"7","article-title":"The structure of the local detector of the reprint model of the object in the image","volume":"9","author":"Kulikov","year":"2021","journal-title":"Russ. Technol. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1016\/j.neucom.2005.12.126","article-title":"Extreme learning machine: Theory and applications","volume":"70","author":"Huang","year":"2006","journal-title":"Neurocomputing"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Demidova, L.A. (2021). Two-stage hybrid data classifiers based on SVM and kNN algorithms. Symmetry, 13.","DOI":"10.3390\/sym13040615"},{"key":"ref_5","unstructured":"Huang, W., and Yin, H. (2009, January 7\u201310). Linear and nonlinear dimensionality reduction for face recognition. Proceedings of the 2009 16th IEEE International Conference on Image Processing (ICIP), Cairo, Egypt."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1002\/wics.101","article-title":"Principal component analysis","volume":"2","author":"Abdi","year":"2010","journal-title":"Wiley Interdiscip. Rev. Comput. Stat."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1109\/T-C.1969.222678","article-title":"A nonlinear mapping for data structure analysis","volume":"100","author":"Sammon","year":"1969","journal-title":"IEEE Trans. Comput."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1373","DOI":"10.1162\/089976603321780317","article-title":"Laplacian eigenmaps for dimensionality reduction and data representation","volume":"15","author":"Belkin","year":"2003","journal-title":"Neural Comput."},{"key":"ref_9","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Hinton","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"McInnes, L., Healy, J., and Melville, J. (2018). UMAP: Uniform manifold approximation and projection for dimension reduction. arXiv.","DOI":"10.21105\/joss.00861"},{"key":"ref_11","unstructured":"Amid, E., and Warmuth, M.K. (2019). TriMap: Large-scale dimensionality reduction using triplets. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1537","DOI":"10.1038\/s41467-020-15351-4","article-title":"Dimensionality reduction by UMAP to visualize physical and genetic interactions","volume":"11","author":"Dorrity","year":"2020","journal-title":"Nat. Commun."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1038\/nbt.4314","article-title":"Dimensionality reduction for visualizing single-cell data using UMAP","volume":"37","author":"Becht","year":"2019","journal-title":"Nat. Biotechnol."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Mazher, A. (2020). Visualization framework for high-dimensional spatio-temporal hydrological gridded datasets using machine-learning techniques. Water, 12.","DOI":"10.3390\/w12020590"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Allaoui, M., Kherfi, M.L., and Cheriet, A. (2020). Considerably improving clustering algorithms using UMAP dimensionality reduction technique: A comparative study. International Conference on Image and Signal Processing, Springer.","DOI":"10.1007\/978-3-030-51935-3_34"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"104264","DOI":"10.1016\/j.compbiomed.2021.104264","article-title":"UMAP-assisted K-means clustering of large-scale SARS-CoV-2 mutation datasets","volume":"131","author":"Hozumi","year":"2021","journal-title":"Comput. Biol. Med."},{"key":"ref_17","unstructured":"Cl\u00e9ment, P., Bouleux, G., and Cheutet, V. (2021, January 10\u201315). Improved Time-Series Clustering with UMAP dimension reduction method. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Weijler, L., Kowarsch, F., Wodlinger, M., Reiter, M., Maurer-Granofszky, M., Schumich, A., and Dworzak, M.N. (2022). UMAP Based Anomaly Detection for Minimal Residual Disease Quantification within Acute Myeloid Leukemia. Cancers, 14.","DOI":"10.3390\/cancers14040898"},{"key":"ref_19","unstructured":"Wang, Y., Huang, H., Rudin, C., and Shaposhnik, Y. (2020). Understanding how dimension reduction tools work: An empirical approach to deciphering t-SNE, UMAP, TriMAP, and PaCMAP for data visualization. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/0020-0255(93)90073-U","article-title":"Some new information measures for fuzzy sets","volume":"67","author":"Bhandari","year":"1993","journal-title":"Inf. Sci."},{"key":"ref_21","first-page":"213","article-title":"On logarithmic fuzzy measures of information and discrimination","volume":"37","author":"Jain","year":"2016","journal-title":"J. Inf. Optim. Sci."},{"key":"ref_22","first-page":"12","article-title":"On UMAP\u2019s true loss function","volume":"34","author":"Damrich","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1109\/18.61115","article-title":"Divergence measures based on the Shannon entropy","volume":"37","author":"Lin","year":"1991","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_24","first-page":"79","article-title":"Fuzzy cross-entropy, mean, variance, skewness models for portfolio selection","volume":"26","author":"Bhattacharyya","year":"2014","journal-title":"J. King Saud Univ. Comput. Inf. Sci."},{"key":"ref_25","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_26","unstructured":"Dong, W., Moses, C., and Li, K. (April, January 28). Efficient k-nearest neighbor graph construction for generic similarity measures. Proceedings of the 20th International Conference on World Wide Web, Hyderabad, India."},{"key":"ref_27","unstructured":"Ruder, S. (2016). An overview of gradient descent optimization algorithms. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1016\/j.procs.2021.04.156","article-title":"Application of chaotic Fish School Search optimization algorithm with exponential step decay in neural network loss function optimization","volume":"186","author":"Demidova","year":"2021","journal-title":"Procedia Comput. Sci."},{"key":"ref_29","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_30","unstructured":"Alpaydin, E., and Kaynak, C. (2022, February 20). Optical Recognition of Handwritten Digits Data Set. UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/optical+recognition+of+handwritten+digits."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","article-title":"Array programming with NumPy","volume":"585","author":"Harris","year":"2020","journal-title":"Nature"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lam, S.K., Pitrou, A., and Seibert, S. (2015, January 15). Numba: A LLVM-based python JIT compiler. Proceedings of the Second Workshop on the LLVM Compiler Infrastructure in HPC, Austin, TX, USA.","DOI":"10.1145\/2833157.2833162"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ellson, J., Gansner, E.R., Koutsofios, E., North, S.C., and Woodhull, G. (2004). Graphviz and dynagraph\u2014static and dynamic graph drawing tools. Graph Drawing Software, Springer.","DOI":"10.1007\/978-3-642-18638-7_6"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"738","DOI":"10.1016\/j.ins.2021.12.083","article-title":"SLC-GAN: An Automated Myocardial Infarction Detection Model Based on Generative Adversarial Networks and Convolutional Neural Networks with Single-Lead Electrocardiogram Synthesis","volume":"589","author":"Li","year":"2022","journal-title":"Inf. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1007\/s12539-020-00411-6","article-title":"SUSCC: Secondary Construction of Feature Space based on UMAP for Rapid and Accurate Clustering Large-scale Single Cell RNA-seq Data","volume":"13","author":"Wang","year":"2021","journal-title":"Interdiscip. Sci. Comput. Life Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3477","DOI":"10.1021\/acs.analchem.0c04798","article-title":"Spatial segmentation of mass spectrometry imaging data by combining multivariate clustering and univariate thresholding","volume":"93","author":"Hu","year":"2021","journal-title":"Anal. Chem."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Chernyshov, K.R. (2019, January 29\u201331). Tsallis Divergence of Order \u00bd in System Identification Related Problems. Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics (ICINCO 2019), Prague, Czech Republic.","DOI":"10.5220\/0007919105230533"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Jun, Y., Jun, Z., and Xuefeng, Y. (2012, January 14\u201316). Two-dimensional Tsallis Symmetric Cross Entropy Image Threshold Segmentation. Proceedings of the 2012 Fourth International Symposium on Information Science and Engineering, Shanghai, China.","DOI":"10.1109\/ISISE.2012.88"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Verma, R., Merig\u00f3, J.M., and Sahni, M. (2018, January 18\u201321). On Generalized Fuzzy Jensen-Exponential Divergence and its Application to Pattern Recognition. Proceedings of the 2018 IEEE Symposium Series on Computational Intelligence (SSCI), Bangalore, India.","DOI":"10.1109\/SSCI.2018.8628862"},{"key":"ref_40","unstructured":"Dua, D., and Graff, C. (2022, April 12). UCI Machine Learning Repository. Irvine, CA: University of California, School of Information and Computer Science. Available online: http:\/\/archive.ics.uci.edu\/ml."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/4\/113\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:55:06Z","timestamp":1760136906000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/4\/113"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,15]]},"references-count":40,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,4]]}},"alternative-id":["jimaging8040113"],"URL":"https:\/\/doi.org\/10.3390\/jimaging8040113","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,15]]}}}