{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:35:08Z","timestamp":1760243708985,"version":"build-2065373602"},"reference-count":17,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2012,8,8]],"date-time":"2012-08-08T00:00:00Z","timestamp":1344384000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Recently the identity of de Bruijn type between the relative entropy and the relative Fisher information with the reference moving has been unveiled by Verd\u00fa via MMSE in estimation theory. In this paper, we shall give another proof of this identity in more direct way that the derivative is calculated by applying integrations by part with the heat equation. We shall also derive an integral representation of the relative entropy, as one of the applications of which the logarithmic Sobolev inequality for centered Gaussian measures will be given.<\/jats:p>","DOI":"10.3390\/e14081469","type":"journal-article","created":{"date-parts":[[2012,8,8]],"date-time":"2012-08-08T12:25:01Z","timestamp":1344428701000},"page":"1469-1477","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["An Integral Representation of the Relative Entropy"],"prefix":"10.3390","volume":"14","author":[{"given":"Miku","family":"Hirata","sequence":"first","affiliation":[{"name":"Department of Mathematics, Ochanomizu University, 2-1-1, Otsuka, Bunkyo-ku, Tokyo 112-8610, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aya","family":"Nemoto","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Ochanomizu University, 2-1-1, Otsuka, Bunkyo-ku, Tokyo 112-8610, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hiroaki","family":"Yoshida","sequence":"additional","affiliation":[{"name":"Department of Information Sciences, Ochanomizu University, 2-1-1, Otsuka, Bunkyo-ku, Tokyo 112-8610, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2012,8,8]]},"reference":[{"key":"ref_1","unstructured":"Cover, T., and Thomas, J. (2006). Elements of Information Theory, Wiley-Interscience. [2nd ed.]."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/S0019-9958(59)90348-1","article-title":"Some inequalities satisfied by the quantities of information of Fisher and Shannon","volume":"2","author":"Stam","year":"1959","journal-title":"Inf. Contr."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1109\/TIT.1965.1053768","article-title":"The convolution inequality for entropy powers","volume":"2","author":"Blachman","year":"1965","journal-title":"IEEE Trans. Inform. Theor."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/0022-1236(91)90155-X","article-title":"Superadditivity of Fisher\u2019s information and logarithmic Sobolev inequalities","volume":"101","author":"Carlen","year":"1991","journal-title":"J. Funct. Anal."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1007\/s00220-002-0777-1","article-title":"Cercignani\u2019s conjecture is sometimes true and always almost true","volume":"234","author":"Villani","year":"2003","journal-title":"Commun. Math. Phys."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2317","DOI":"10.1109\/TIT.2007.899484","article-title":"Generalized entropy power inequalities and monotonicity properties of information","volume":"53","author":"Madiman","year":"2007","journal-title":"IEEE Trans. Inform. Theor."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1007\/s00440-004-0344-0","article-title":"Fisher information inequalities and the central limit theorem","volume":"129","author":"Johnson","year":"2004","journal-title":"Probab. Theor. Relat. Field."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1501","DOI":"10.1109\/18.104312","article-title":"Information theoretic inequalities","volume":"37","author":"Dembo","year":"1991","journal-title":"IEEE Trans. Inform. Theor."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1081\/PDE-100002246","article-title":"On convex Sobolev inequalities and the rate of convergence to equilibrium for Fokker\u2013Planck type equations","volume":"26","author":"Arnold","year":"2001","journal-title":"Comm Part. Differ. Equat."},{"key":"ref_10","unstructured":"Bakry, D., and \u00c9mery, M. (1985). S\u00e9minar de Probabilit\u00e9s XIX, 1983\/84, Lecture Notes in Math. 1123, Springer-Verlag."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1006\/jfan.1999.3557","article-title":"Generalization of an inequality by Talagrand and links with the logarithmic Sobolev inequality","volume":"173","author":"Otto","year":"2000","journal-title":"J. Funct. Anal."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3712","DOI":"10.1109\/TIT.2010.2050800","article-title":"Mismatched estimation and relative entropy","volume":"56","year":"2010","journal-title":"IEEE Trans. Inform. Theor."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1261","DOI":"10.1109\/TIT.2005.844072","article-title":"Mutual information and minimum mean-square error in Gaussian channels","volume":"51","author":"Guo","year":"2005","journal-title":"IEEE Trans. Inform. Theor."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1695","DOI":"10.1109\/18.850718","article-title":"A short proof of the concavity of entropy power","volume":"46","author":"Villani","year":"2000","journal-title":"IEEE Trans. Inform. Theor."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Johnson, O. (2004). Information Theory and the Central Limit Theorem, Imperial College Press.","DOI":"10.1142\/9781860945373"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1214\/aop\/1176992632","article-title":"Entropy and the central limit theorem","volume":"14","author":"Barron","year":"1986","journal-title":"Ann. Probab."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1061","DOI":"10.2307\/2373688","article-title":"Logarithmic Sobolev inequalities","volume":"97","author":"Gross","year":"1975","journal-title":"Amer. J. Math."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/14\/8\/1469\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:51:40Z","timestamp":1760219500000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/14\/8\/1469"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,8,8]]},"references-count":17,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2012,8]]}},"alternative-id":["e14081469"],"URL":"https:\/\/doi.org\/10.3390\/e14081469","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2012,8,8]]}}}