{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:41:19Z","timestamp":1760236879561,"version":"build-2065373602"},"reference-count":15,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,31]],"date-time":"2021-12-31T00:00:00Z","timestamp":1640908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>We construct a 2-categorical extension of the relative entropy functor of Baez and Fritz, and show that our construction is functorial with respect to vertical morphisms. Moreover, we show such a \u20182-relative entropy\u2019 satisfies natural 2-categorial analogues of convex linearity, vanishing under optimal hypotheses, and lower semicontinuity. While relative entropy is a relative measure of information between probability distributions, we view our construction as a relative measure of information between channels.<\/jats:p>","DOI":"10.3390\/e24010074","type":"journal-article","created":{"date-parts":[[2022,1,3]],"date-time":"2022-01-03T20:49:38Z","timestamp":1641242978000},"page":"74","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["On a 2-Relative Entropy"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8816-1364","authenticated-orcid":false,"given":"James","family":"Fullwood","sequence":"first","affiliation":[{"name":"School of Mathematical Sciences, Shanghai Jiao Tong University, 800 Dongchuan Road, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,31]]},"reference":[{"key":"ref_1","first-page":"422","article-title":"A Bayesian characterization of relative entropy","volume":"29","author":"Baez","year":"2014","journal-title":"Theory Appl. Categ."},{"key":"ref_2","unstructured":"Mac Lane, S. (1998). Categories for the Working Mathematician, Springer. [2nd ed.]."},{"key":"ref_3","unstructured":"Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, Wiley-Interscience."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1945","DOI":"10.3390\/e13111945","article-title":"A characterization of entropy in terms of information loss","volume":"13","author":"Baez","year":"2011","journal-title":"Entropy"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.ic.2016.02.008","article-title":"A mathematical theory of resources","volume":"250","author":"Coecke","year":"2016","journal-title":"Inform. Comput."},{"key":"ref_6","first-page":"227","article-title":"On the concept of entropy of a finite probabilistic scheme","volume":"11","author":"Faddeev","year":"1956","journal-title":"Uspekhi Mat. Nauk"},{"key":"ref_7","unstructured":"Fong, B. (2012). Causal Theories: A Categorical Perspective on Bayesian Networks. [Master\u2019s Thesis, University of Oxford]."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"107239","DOI":"10.1016\/j.aim.2020.107239","article-title":"A synthetic approach to Markov kernels, conditional independence and theorems on sufficient statistics","volume":"370","author":"Fritz","year":"2020","journal-title":"Adv. Math."},{"key":"ref_9","unstructured":"Fullwood, J. (2021). An axiomatic characterization of mutual information. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Fullwood, J., and Parzygnat, A.P. (2021). The Information Loss of a Stochastic Map. Entropy, 23.","DOI":"10.3390\/e23081021"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"023302","DOI":"10.1063\/1.5026999","article-title":"A short characterization of relative entropy","volume":"60","author":"Leinster","year":"2019","journal-title":"J. Math. Phys."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Leinster, T. (2021). Entropy and Diversity: The Axiomatic Approach, Cambridge University Press.","DOI":"10.1017\/9781108963558"},{"key":"ref_13","unstructured":"Parzygnat, A.P. (2020). A functorial characterization of von Neumann entropy. IH\u00c9S pr\u00e9publications. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"938","DOI":"10.1017\/S0960129518000488","article-title":"Disintegration and Bayesian inversion via string diagrams","volume":"29","author":"Cho","year":"2019","journal-title":"Math. Struct. Comput. Sci."},{"key":"ref_15","first-page":"375","article-title":"Information transformers: Category-theoretical structure, informativeness, decision-making problems","volume":"19","author":"Golubtsov","year":"2004","journal-title":"Hadron. J. Suppl."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/74\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:56:47Z","timestamp":1760169407000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/74"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,31]]},"references-count":15,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["e24010074"],"URL":"https:\/\/doi.org\/10.3390\/e24010074","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2021,12,31]]}}}