{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T13:02:51Z","timestamp":1781614971289,"version":"3.54.5"},"reference-count":35,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2017,6,13]],"date-time":"2017-06-13T00:00:00Z","timestamp":1497312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Information entropy and its extension, which are important generalizations of entropy, are currently applied to many research domains. In this paper, a novel generalized relative entropy is constructed to avoid some defects of traditional relative entropy. We present the structure of generalized relative entropy after the discussion of defects in relative entropy. Moreover, some properties of the provided generalized relative entropy are presented and proved. The provided generalized relative entropy is proved to have a finite range and is a finite distance metric. Finally, we predict nucleosome positioning of fly and yeast based on generalized relative entropy and relative entropy respectively. The experimental results show that the properties of generalized relative entropy are better than relative entropy.<\/jats:p>","DOI":"10.3390\/e19060269","type":"journal-article","created":{"date-parts":[[2017,6,14]],"date-time":"2017-06-14T03:19:32Z","timestamp":1497410372000},"page":"269","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":48,"title":["A Novel Distance Metric: Generalized Relative Entropy"],"prefix":"10.3390","volume":"19","author":[{"given":"Shuai","family":"Liu","sequence":"first","affiliation":[{"name":"College of Computer Science, Inner Mongolia University, Hohhot 010010, China"},{"name":"Inner Mongolia Key Laboratory of Data Mining and Knowledge Engineering, Hohhot 010010, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mengye","family":"Lu","sequence":"additional","affiliation":[{"name":"College of Computer Science, Inner Mongolia University, Hohhot 010010, China"},{"name":"Inner Mongolia Key Laboratory of Data Mining and Knowledge Engineering, Hohhot 010010, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gaocheng","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Computer Science, Inner Mongolia University, Hohhot 010010, China"},{"name":"Inner Mongolia Key Laboratory of Data Mining and Knowledge Engineering, Hohhot 010010, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zheng","family":"Pan","sequence":"additional","affiliation":[{"name":"College of Computer Science, Inner Mongolia University, Hohhot 010010, China"},{"name":"Inner Mongolia Key Laboratory of Data Mining and Knowledge Engineering, Hohhot 010010, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2017,6,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1007\/BF01608825","article-title":"Uncertainty relations for information entropy in wave mechanics","volume":"44","author":"Mycielski","year":"1975","journal-title":"Commun. Math. Phys."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/BF01609834","article-title":"Relative entropy and the Wigner-Yanase-Dyson-Lieb concavity in an interpolation theory","volume":"54","author":"Uhlmann","year":"1977","journal-title":"Commun. Math. Phys."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/TIT.1980.1056144","article-title":"Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy","volume":"26","author":"Shore","year":"1980","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1134","DOI":"10.1103\/PhysRevA.33.1134","article-title":"Independent coordinates for strange attractors from mutual information","volume":"33","author":"Fraser","year":"1986","journal-title":"Phys. Rev. A"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1073\/pnas.88.6.2297","article-title":"Approximate entropy as a measure of system complexity","volume":"88","author":"Pincus","year":"1991","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_6","unstructured":"Hyv\u00e4rinen, A. (2017, June 12). New Approximations of Differential Entropy for Independent Component Analysis and Projection Pursuit. Available online: https:\/\/papers.nips.cc\/paper\/1408-new-approximations-of-differential-entropy-for-independent-component-analysis-and-projection-pursuit.pdf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1109\/9.847720","article-title":"Minimax optimal control of stochastic uncertain systems with relative entropy constraints","volume":"45","author":"Petersen","year":"2000","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1667","DOI":"10.1109\/TPAMI.2002.1114861","article-title":"Input feature selection by mutual information based on Parzen window","volume":"24","author":"Kwak","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"986","DOI":"10.1109\/TMI.2003.815867","article-title":"Mutual-information-based registration of medical images: A survey","volume":"22","author":"Pluim","year":"2003","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_10","first-page":"29","article-title":"Estimation of the Effect of Cadence on Gait Stability in Young and Elderly People using Approximate Entropy Technique","volume":"4","author":"Arif","year":"2004","journal-title":"Meas. Sci. Rev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/j.ecolmodel.2005.03.026","article-title":"Maximum entropy modeling of species geographic distributions","volume":"190","author":"Phillips","year":"2006","journal-title":"Ecol. Model."},{"key":"ref_12","first-page":"63","article-title":"Application of Mutual Information based Least dependent Component Analysis (MILCA) for Removal of Ocular Artifacts from Electroencephalogram","volume":"1","author":"Krishnaveni","year":"2006","journal-title":"Int. J. Biomed. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"070502","DOI":"10.1103\/PhysRevLett.100.070502","article-title":"Area laws in quantum systems: Mutual information and correlations","volume":"100","author":"Wolf","year":"2008","journal-title":"Phys. Rev. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"854","DOI":"10.3390\/e11040854","article-title":"Use of Maximum Entropy Modeling in Wildlife Research","volume":"11","author":"Baldwin","year":"2009","journal-title":"Entropy"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3712","DOI":"10.1109\/TIT.2010.2050800","article-title":"Mismatched Estimation and Relative Entropy","volume":"56","author":"Verdu","year":"2010","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1007\/s00145-010-9084-8","article-title":"Mutual Information Analysis: A Comprehensive Study","volume":"24","author":"Batina","year":"2011","journal-title":"J. Cryptol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"073506","DOI":"10.1063\/1.4811856","article-title":"On the asymmetry of the relative entropy","volume":"54","author":"Audenaert","year":"2013","journal-title":"J. Math. Phys."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4328","DOI":"10.1109\/TGRS.2013.2281391","article-title":"A Novel Coarse-to-Fine Scheme for Automatic Image Registration Based on SIFT and Mutual Information","volume":"52","author":"Gong","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1016\/j.ins.2014.05.045","article-title":"Generalized decomposition and cross entropy methods for many-objective optimization","volume":"282","author":"Giagkiozis","year":"2014","journal-title":"Inf. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4583","DOI":"10.3390\/e16084583","article-title":"Information Entropy-Based Metrics for Measuring Emergences in Artificial Societies","volume":"16","author":"Tang","year":"2014","journal-title":"Entropy"},{"key":"ref_21","first-page":"921","article-title":"Entropy-based discretization methods for ranking data","volume":"329","author":"Soares","year":"2015","journal-title":"Inf. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/j.asoc.2014.10.008","article-title":"Adaptive molecular docking method based on information entropy genetic algorithm","volume":"26","author":"Li","year":"2015","journal-title":"Appl. Soft Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.physletb.2015.01.015","article-title":"Isobaric yield ratio difference and Shannon information entropy","volume":"742","author":"Ma","year":"2015","journal-title":"Phys. Lett. B"},{"key":"ref_24","first-page":"4337","article-title":"The operational meaning of min- and max-entropy","volume":"55","author":"Renner","year":"2015","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1711","DOI":"10.1109\/TIT.2016.2528285","article-title":"A Generalization of Majorization that Characterizes Shannon Entropy","volume":"62","author":"Pastena","year":"2016","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.patcog.2016.02.013","article-title":"Feature selection in mixed data: A method using a novel fuzzy rough set-based information entropy","volume":"56","author":"Zhang","year":"2016","journal-title":"Pattern Recognit."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Guariglia, E. (2016). Entropy and Fractal Antennas. Entropy, 18.","DOI":"10.3390\/e18030084"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1515\/phys-2015-0058","article-title":"Logical entropy of quantum dynamical systems","volume":"14","author":"Ebrahimzadeh","year":"2016","journal-title":"Open Phys."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1109\/TITS.2015.2491365","article-title":"A Hybrid Method for Short-Term Traffic Congestion Forecasting Using Genetic Algorithms and Cross Entropy","volume":"17","author":"Onieva","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2907","DOI":"10.1109\/TIT.2016.2545680","article-title":"Strengthened Monotonicity of Relative Entropy via Pinched Petz Recovery Map","volume":"62","author":"Sutter","year":"2016","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.jcp.2016.11.021","article-title":"An estimator for the relative entropy rate of path measures for stochastic differential equations","volume":"330","author":"Opper","year":"2017","journal-title":"J. Comput. Phys."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.asoc.2017.03.008","article-title":"An EEMD-based multi-scale fuzzy entropy approach for complexity analysis in clean energy markets","volume":"56","author":"Tang","year":"2017","journal-title":"Appl. Soft Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1522","DOI":"10.1093\/bioinformatics\/btu083","article-title":"iNuc-PseKNC: A sequence-based predictor for predicting nucleosome positioning in genomes with pseudo k-tuple nucleotide composition","volume":"30","author":"Guo","year":"2014","journal-title":"Bioinformatics"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.ygeno.2015.12.005","article-title":"Using deformation energy to analyze nucleosome positioning in genomes","volume":"107","author":"Chen","year":"2016","journal-title":"Genomics"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1093\/bioinformatics\/btw562","article-title":"Prediction of nucleosome positioning by the incorporation of frequencies and distributions of three different nucleotide segment lengths into a general pseudo k-tuple nucleotide composition","volume":"33","author":"Awazu","year":"2017","journal-title":"Bioinformatics"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/6\/269\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:38:51Z","timestamp":1760207931000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/6\/269"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,13]]},"references-count":35,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2017,6]]}},"alternative-id":["e19060269"],"URL":"https:\/\/doi.org\/10.3390\/e19060269","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,6,13]]}}}