{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T22:33:06Z","timestamp":1777761186362,"version":"3.51.4"},"reference-count":127,"publisher":"Emerald","issue":"1-2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2010,12,13]]},"abstract":"<jats:p>This monograph is based on lecture notes of a graduate course, which focuses on the relations between information theory and statistical physics. The course was delivered at the Technion during the Spring of 2010 for the first time, and its target audience consists of EE graduate students in the area of communications and information theory, as well as graduate students in Physics who have basic background in information theory. Strong emphasis is given to the analogy and parallelism between information theory and statistical physics, as well as to the insights, the analysis tools and techniques that can be borrowed from statistical physics and \u2018imported\u2019 to certain problem areas in information theory. This is a research trend that has been very active in the last few decades, and the hope is that by exposing the students to the meeting points between these two disciplines, their background and perspective may be expanded and enhanced. This monograph is substantially revised and expanded relative to an earlier version posted in arXiv (1006.1565v1 [cs.iT]).<\/jats:p>","DOI":"10.1561\/0100000052","type":"journal-article","created":{"date-parts":[[2010,12,21]],"date-time":"2010-12-21T06:21:23Z","timestamp":1292912483000},"page":"1-212","source":"Crossref","is-referenced-by-count":79,"title":["Statistical Physics and Information Theory"],"prefix":"10.1108","volume":"6","author":[{"given":"Neri","family":"Merhav","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, Technion\u2014Israel Institute of Technology , Haifa 32000,","place":["Israel"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","published-online":{"date-parts":[[2010,12,13]]},"reference":[{"key":"2026032712065759900_ref001","article-title":"Spin glass computations and Ruelle\u2019s probability cascades","author":"Arguin","year":"2006"},{"issue":"9","key":"2026032712065759900_ref002","doi-asserted-by":"crossref","first-page":"2568","DOI":"10.1109\/TIT.2002.800480","article-title":"Random codes: minimum distances and error exponents","volume":"48","author":"Barg","year":"2002","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref003","article-title":"The physical meaning of R\u00e9nyi relative entropies","author":"Ba\u011fci","year":"2007"},{"key":"2026032712065759900_ref004","volume-title":"Exactly Solved Models in Statistical Mechanics","author":"Baxter","year":"1982"},{"key":"2026032712065759900_ref005","volume-title":"Statistical Mechanics, Fluctuations and Noise","author":"Beck","year":"1976"},{"key":"2026032712065759900_ref006","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1016\/S1355-2198(03)00039-X","article-title":"Notes on Landauer\u2019s principle, reversible computation and Maxwell\u2019s demon","volume":"34","author":"Bennett","year":"2003","journal-title":"Studies in History and Philosophy of Modern Physics"},{"key":"2026032712065759900_ref007","article-title":"Rigorous and general definition of thermodynamic entropy","author":"Beretta","year":"2010"},{"key":"2026032712065759900_ref008","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511804441","volume-title":"Convex Optimization","author":"Boyd","year":"2004"},{"key":"2026032712065759900_ref009","doi-asserted-by":"crossref","first-page":"1823","DOI":"10.1088\/0305-4470\/26\/8\/011","article-title":"Directed polymers on trees: A martingale approach","volume":"26","author":"Buffet","year":"1993","journal-title":"Journal of Physics A: Mathematical and General"},{"key":"2026032712065759900_ref010","first-page":"509","volume-title":"Proceedings of ISIT 2008","author":"Cousseau","year":"2008"},{"key":"2026032712065759900_ref011","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevE.78.021124","article-title":"Statistical mechanics of lossy compression for non-monotonic multilayer perceptrons","volume":"78","author":"Cousseau","year":"2008","journal-title":"Physical Review E"},{"issue":"2","key":"2026032712065759900_ref012","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1109\/18.485708","article-title":"Universal portfolios with side information","volume":"IT-42","author":"Cover","year":"1996","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref013","volume-title":"Elements of Information Theory","author":"Cover","year":"2006","edition":"Second"},{"key":"2026032712065759900_ref014","doi-asserted-by":"crossref","first-page":"041119","DOI":"10.1103\/PhysRevE.75.041119","article-title":"Beyond Boltzmann\u2013Gibbs statistics: Maximum entropy hyperensembles out of equilibrium","volume":"75","author":"Crooks","year":"2007","journal-title":"Physical Review E"},{"key":"2026032712065759900_ref015","first-page":"1","article-title":"A class of measures of informativity of observation channels","volume":"22","author":"Csisz\u00e1r","year":"1972","journal-title":"Periodica Mathematica Hungarica"},{"key":"2026032712065759900_ref016","volume-title":"Information Theory: Coding Theorems for Discrete Earlier Memoryless Systems","author":"Csisz\u00e1r","year":"1981"},{"key":"2026032712065759900_ref017","unstructured":"B.\n              Dacorogna\n             and P.Mar\u00e9chal, \u201cThe role of perspective functions in convexity, polyconvexity, rank-one convexity and separate convexity,\u201d http:\/\/caa.epfl.ch\/publications\/2008-The_role_of_perspective_functions_in_convexity.pdf."},{"key":"2026032712065759900_ref018","article-title":"The explicit expression of the fugacity for hard-sphere Bose and Fermi gases","author":"Dai","year":"2009"},{"issue":"4","key":"2026032712065759900_ref019","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1109\/TIT.1975.1055414","article-title":"On tree coding with a fidelity criterion","volume":"IT-21","author":"Davis","year":"1975","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref020","volume-title":"Asymptotic Methods in Analysis","author":"de Bruijn","year":"1981"},{"key":"2026032712065759900_ref021","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1051\/jphys:01980004109092300","article-title":"White and weighted averages over solutions of Thouless Anderson Palmer equations for the Sherrington Kirkpatrick spin glass","volume":"41","author":"De Dominicis","year":"1980","journal-title":"Journal de Physique"},{"key":"2026032712065759900_ref022","doi-asserted-by":"crossref","unstructured":"C. R.\n              de Oliveira\n             and T.Werlang, \u201cErgodic hypothesis in classical statistical mechanics,\u201d Revista Brasileira de Ensino de F\u00edsica, vol. 29, no. 2, pp. 189\u2013201, Also available on\u2013line: http:\/\/www.sbfisica.org.br\/rbef\/pdf\/060601.pdf, 2007.","DOI":"10.1590\/S1806-11172007000200003"},{"issue":"1","key":"2026032712065759900_ref023","first-page":"29","article-title":"The random energy model","volume":"67","author":"Derrida","year":"1980","journal-title":"Physics Reports (Review Section of Physics Letters)"},{"issue":"2","key":"2026032712065759900_ref024","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1103\/PhysRevLett.45.79","article-title":"Random-energy model: Limit of a family of disordered models","volume":"45","author":"Derrida","year":"1980","journal-title":"Physical Review Letters"},{"issue":"5","key":"2026032712065759900_ref025","doi-asserted-by":"crossref","first-page":"2613","DOI":"10.1103\/PhysRevB.24.2613","article-title":"Random-energy model: An exactly solvable model for disordered systems","volume":"24","author":"Derrida","year":"1981","journal-title":"Physical Review B"},{"key":"2026032712065759900_ref026","doi-asserted-by":"crossref","first-page":"L-401","DOI":"10.1051\/jphyslet:01985004609040100","article-title":"A generalization of the random energy model which includes correlations between energies","volume":"46","author":"Derrida","year":"1985","journal-title":"Journal de Physique\u2014Lettres"},{"key":"2026032712065759900_ref027","doi-asserted-by":"crossref","first-page":"2253","DOI":"10.1088\/0022-3719\/19\/13\/015","article-title":"Solution of the generalised random energy model","volume":"19","author":"Derrida","year":"1986","journal-title":"Jounal of Physics C: Solid State Physics"},{"issue":"3","key":"2026032712065759900_ref028","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1109\/TIT.1974.1055234","article-title":"Tree encoding of Gaussian sources","volume":"IT-20","author":"Dick","year":"1974","journal-title":"IEEE Transformations on Information Theory"},{"key":"2026032712065759900_ref029","volume-title":"The Theory of Polymer Dynamics","author":"Doi","year":"1986"},{"key":"2026032712065759900_ref030","article-title":"One more discussion on the replica trick: The examples of exact solutions","author":"Dotsenko","year":"2010"},{"key":"2026032712065759900_ref031","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4613-8533-2","volume-title":"Entropy, Large Deviations, and Statistical Mechanics","author":"Ellis","year":"1985"},{"issue":"1","key":"2026032712065759900_ref032","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1109\/TIT.2009.2034892","article-title":"Error exponents of optimum decoding for the interference channel","volume":"56","author":"Etkin","year":"2010","journal-title":"IEEE Transactions on Information Theory"},{"issue":"2","key":"2026032712065759900_ref033","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1109\/TIT.1968.1054129","article-title":"Exponential error bounds for erasure, list, and decision feedback schemes","volume":"IT-14","author":"Forney","year":"1968","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref034","unstructured":"G. D.\n              Forney, Jr. and A.Montanari, \u201cOn exponential error bounds for random codes on the DMC,\u201d manuscript, http:\/\/www.stanford.edu\/~montanar\/PAPERS\/FILEPAP\/dmc.ps, 2001."},{"key":"2026032712065759900_ref035","volume-title":"Information Theory and Reliable Communication","author":"Gallager","year":"1968"},{"issue":"1","key":"2026032712065759900_ref036","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1109\/TIT.1974.1055166","article-title":"Tree encoding for symmetric sources with a distortion measure","volume":"IT-20","author":"Gallager","year":"1974","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref037","volume-title":"Source Coding Theory","author":"Gray","year":"1990"},{"issue":"6","key":"2026032712065759900_ref038","doi-asserted-by":"crossref","first-page":"1982","DOI":"10.1109\/TIT.2005.847700","article-title":"Randomly spread CDMA: Asymptotics via statistical physics","volume":"51","author":"Guo","year":"2005","journal-title":"IEEE Transactions on Information Theory"},{"issue":"4","key":"2026032712065759900_ref039","doi-asserted-by":"crossref","first-page":"2602","DOI":"10.1103\/PhysRevA.59.2602","article-title":"Universal geometric approach to uncertainty, entropy, and information","volume":"59","author":"Hall","year":"1999","journal-title":"Physical Review A"},{"key":"2026032712065759900_ref040","volume-title":"Statistical Physics\u2014An Advanced Approach with Applications","author":"Honerkamp","year":"2002","edition":"2nd"},{"key":"2026032712065759900_ref041","doi-asserted-by":"crossref","first-page":"041104","DOI":"10.1103\/PhysRevE.77.041104","article-title":"Nonequilibrium temperature and thermometry in heat-conducting \u03d54 models","volume":"77","author":"Hoover","year":"2008","journal-title":"Physical Review E"},{"issue":"1","key":"2026032712065759900_ref042","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1143\/JPSJ.74.488","article-title":"Statistical mechanical approach to error exponents of lossy data compression","volume":"74","author":"Hosaka","year":"2005","journal-title":"Journal of the Physical Society of Japan"},{"key":"2026032712065759900_ref043","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1109\/TIT.1981.1056322","article-title":"Generalization of Huffman coding to minimize the probability of buffer overflow","volume":"27","author":"Humblet","year":"1981","journal-title":"IEEE Transactions on Information Theory"},{"issue":"14","key":"2026032712065759900_ref044","doi-asserted-by":"crossref","first-page":"2690","DOI":"10.1103\/PhysRevLett.78.2690","article-title":"Nonequilibrium equality for free energy differences","volume":"78","author":"Jarzynski","year":"1997","journal-title":"Physical Review Letters"},{"key":"2026032712065759900_ref045","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1103\/PhysRev.106.620","article-title":"Information theory and statistical mechanics","volume":"106","author":"Jaynes","year":"1957","journal-title":"Physical Review"},{"key":"2026032712065759900_ref046","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1103\/PhysRev.108.171","article-title":"Information theory and statistical mechanics-II","volume":"108","author":"Jaynes","year":"1957","journal-title":"Physical Review A"},{"issue":"3","key":"2026032712065759900_ref047","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1109\/TIT.1968.1054147","article-title":"Buffer overflow in variable length coding of fixed rate sources","volume":"IT-14","author":"Jelinek","year":"1968","journal-title":"IEEE Transactions on Information Theory"},{"issue":"5","key":"2026032712065759900_ref048","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1109\/TIT.1969.1054355","article-title":"Tree encoding of memoryless time-discrete sources with a fidelity criterion","volume":"IT-15","author":"Jelinek","year":"1969","journal-title":"IEEE Transactions on Information Theory"},{"issue":"1","key":"2026032712065759900_ref049","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1109\/TIT.1971.1054572","article-title":"Instrumentable tree encoding of information sources","volume":"IT-17","author":"Jelinek","year":"1971","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref050","volume-title":"Proceedings of the International Workshop on Statistical\u2013Mechanical Informatics","author":"Kabashima","year":"2008"},{"key":"2026032712065759900_ref051","first-page":"197","article-title":"Statistical mechanics for source coding with a fidelity criterion","volume-title":"Progress of Theoretical Physics","author":"Kabashima","year":"2005"},{"key":"2026032712065759900_ref052","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevE.66.036125","article-title":"Statistical mechanics of typical set decoding","volume":"66","author":"Kabashima","year":"2002","journal-title":"Physical Review E"},{"issue":"1","key":"2026032712065759900_ref053","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1209\/epl\/i1999-00137-2","article-title":"Statistical mechanics of error correcting codes","volume":"45","author":"Kabashima","year":"1999","journal-title":"Europhysics Letters"},{"key":"2026032712065759900_ref054","doi-asserted-by":"crossref","first-page":"R1","DOI":"10.1088\/0305-4470\/37\/6\/R01","article-title":"Statistical mechanics of low-density parity check codes","volume":"37","author":"Kabashima","year":"2004","journal-title":"Journal of Physics A: Mathamatical and General"},{"key":"2026032712065759900_ref055","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511815898","volume-title":"Statistical Physics of Particles","author":"Kardar","year":"2007"},{"key":"2026032712065759900_ref056","first-page":"2507","volume-title":"Proceedings of the ISIT 2009","author":"Kaspi","year":"2009"},{"key":"2026032712065759900_ref057","doi-asserted-by":"crossref","first-page":"080602","DOI":"10.1103\/PhysRevLett.98.080602","article-title":"Dissipation: The phasespace perspective","volume":"98","author":"Kawai","year":"2007","journal-title":"Physical Review Letters"},{"key":"2026032712065759900_ref058","volume-title":"Reversibility and Stochastic Networks","author":"Kelly","year":"1979"},{"key":"2026032712065759900_ref059","first-page":"1373","author":"Kitagawa","year":"2008"},{"key":"2026032712065759900_ref060","volume-title":"Elementary Statistical Physics","author":"Kittel","year":"1958"},{"key":"2026032712065759900_ref061","volume-title":"Statistical Mechanics","author":"Kubo","year":"1961"},{"key":"2026032712065759900_ref062","volume-title":"Course of Theoretical Physics\u2014","author":"Landau","year":"1980","edition":"3rd"},{"key":"2026032712065759900_ref063","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1147\/rd.53.0183","article-title":"Irreversibility and heat generation in the computing process","volume":"5","author":"Landauer","year":"1961","journal-title":"IBM Journal of Research and Development"},{"issue":"3","key":"2026032712065759900_ref064","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1103\/PhysRev.87.410","article-title":"Statistical theory of equations of state and phase transitions. II. Lattice gas and Ising model","volume":"87","author":"Lee","year":"1952","journal-title":"Physical Review"},{"key":"2026032712065759900_ref065","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1007\/3-540-45043-2_11","volume-title":"Spatial Statistics and Statistical Physics","author":"L\u00f6wen","year":"2000"},{"key":"2026032712065759900_ref066","unstructured":"N.\n              Merhav\n            \n          , \u201cAnother look at the physics of large deviations with application to rate\u2013distortion theory,\u201d http:\/\/arxiv.org\/PS_cache\/arxiv\/pdf\/0908\/0908.3562v1.pdf."},{"issue":"3","key":"2026032712065759900_ref067","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1109\/18.79912","article-title":"Universal coding with minimum probability of code word length overflow","volume":"37","author":"Merhav","year":"1991","journal-title":"IEEE Transactions on Information Theory"},{"issue":"10","key":"2026032712065759900_ref068","doi-asserted-by":"crossref","first-page":"4439","DOI":"10.1109\/TIT.2008.929004","article-title":"Error exponents of erasure\/list decoding revisited via moments of distance enumerators","volume":"54","author":"Merhav","year":"2008","journal-title":"IEEE Transactions on Information Theory"},{"issue":"8","key":"2026032712065759900_ref069","doi-asserted-by":"crossref","first-page":"3710","DOI":"10.1109\/TIT.2008.926340","article-title":"An identity of Chernoff bounds with an interpretation in statistical physics and applications in information theory","volume":"54","author":"Merhav","year":"2008","journal-title":"IEEE Transactions on Information Theory"},{"issue":"22","key":"2026032712065759900_ref070","doi-asserted-by":"crossref","first-page":"5662","DOI":"10.1016\/j.physa.2008.05.040","article-title":"The random energy model in a magnetic field and joint source\u2013channel coding","volume":"387","author":"Merhav","year":"2008","journal-title":"Physica A: Statistical Mechanics and Its Applications"},{"issue":"3","key":"2026032712065759900_ref071","doi-asserted-by":"crossref","first-page":"1250","DOI":"10.1109\/TIT.2008.2011445","article-title":"The generalized random energy model and its application to the statistical physics of ensembles of hierarchical codes","volume":"55","author":"Merhav","year":"2009","journal-title":"IEEE Transactions on Information Theory"},{"issue":"1","key":"2026032712065759900_ref072","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1109\/TIT.2008.2008133","article-title":"Relations between random coding exponents and the statistical physics of random codes","volume":"55","author":"Merhav","year":"2009","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref073","article-title":"Data processing theorems and the second law of thermodynamics","volume-title":"IEEE Transactions on Information Theory","author":"Merhav","year":"2010"},{"key":"2026032712065759900_ref074","first-page":"71","volume-title":"Proceedings of ISIT 2010","author":"Merhav","year":"2010"},{"issue":"3","key":"2026032712065759900_ref075","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TIT.2009.2039033","article-title":"On the statistical physics of directed polymers in a random medium and their relation to tree codes","volume":"56","author":"Merhav","year":"2010","journal-title":"IEEE Transactions on Information Theory"},{"issue":"9","key":"2026032712065759900_ref076","doi-asserted-by":"crossref","first-page":"4274","DOI":"10.1109\/TIT.2010.2053867","article-title":"Physics of the Shannon limits","volume":"56","author":"Merhav","year":"2010","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref077","article-title":"Rate\u2013distortion function via minimum mean square error estimation","volume-title":"IEEE Transactions on Information Theory","author":"Merhav","year":"2010"},{"key":"2026032712065759900_ref078","article-title":"Threshold effects in parameter estimation as phase transitions in statistical mechanics","volume-title":"IEEE Transactions on Information Theory","author":"Merhav","year":"2010"},{"issue":"3","key":"2026032712065759900_ref079","doi-asserted-by":"crossref","first-page":"1400","DOI":"10.1109\/TIT.2009.2039047","article-title":"Statistical physics of signal estimation in Gaussian noise: Theory and examples of phase transitions","volume":"56","author":"Merhav","year":"2010","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref080","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780198570837.001.0001","volume-title":"Information, Physics and Computation","author":"M\u00e9zard","year":"2009"},{"issue":"121","key":"2026032712065759900_ref081","article-title":"Turbo codes: The phase transition","volume":"18","author":"Montanari","year":"2000","journal-title":"The European Physical Journal B"},{"issue":"1","key":"2026032712065759900_ref082","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1007\/s100510170089","article-title":"The glassy phase of Gallager codes","volume":"23","author":"Montanari","year":"2001","journal-title":"The European Physical Journal B\u2014Condensed Matter and Complex Systems"},{"key":"2026032712065759900_ref083","article-title":"Statistical mechanics of error exponents for errorcorrecting codes","author":"Mora","year":"2006"},{"key":"2026032712065759900_ref084","doi-asserted-by":"crossref","first-page":"L95","DOI":"10.1088\/0305-4470\/35\/8\/101","article-title":"Statistical mechanics of the data compression theorem","volume":"35","author":"Murayama","year":"2002","journal-title":"Journal of the Physics A: Mathamatical General"},{"key":"2026032712065759900_ref085","article-title":"On the thermodynamic temperature of a general distribution","author":"Narayanan","year":"2007"},{"key":"2026032712065759900_ref086","article-title":"A Shannon entropy-based nonequilibrium temperature of a general distribution with application to Langevin dynamics","author":"Narayanan","year":"2009"},{"key":"2026032712065759900_ref087","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780198509417.001.0001","volume-title":"Statistical Physics of Spin Glasses and Information Processing: An Introduction","author":"Nishimori","year":"2001"},{"issue":"2","key":"2026032712065759900_ref088","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1103\/PhysRev.65.117","article-title":"Crystal statistics. I. A two-dimensional model with an order\u2013disorder transition","volume":"65","author":"Onsager","year":"1944","journal-title":"Physical Review"},{"key":"2026032712065759900_ref089","article-title":"Mean field theory of the glass transition and jamming hard spheres","author":"Parisi","year":"2008"},{"key":"2026032712065759900_ref090","article-title":"Non-equilibrium fluctuation theorems in the presence of local heating","author":"Pradhan","year":"2008"},{"issue":"3\/4","key":"2026032712065759900_ref091","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1023\/A:1004666811087","article-title":"Statistical mechanics approach to coding theory","volume":"96","author":"Procacci","year":"1999","journal-title":"Journal of Statistical Physics"},{"key":"2026032712065759900_ref092","doi-asserted-by":"crossref","first-page":"042103","DOI":"10.1103\/PhysRevE.63.042103","article-title":"Relative entropy: Free energy associated with equilibrium fluctuations and nonequilibrium deviations","volume":"63","author":"Qian","year":"2001","journal-title":"Physical Review E"},{"key":"2026032712065759900_ref093","volume-title":"Fundamentals of Statistical and Thermal Physics","author":"Reif","year":"1965"},{"issue":"1","key":"2026032712065759900_ref094","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1007\/BF01007245","article-title":"Thermodynamic-like transformations in Information Theory","volume":"1","author":"Reiss","year":"1969","journal-title":"Journal of Statistical Physics"},{"issue":"2","key":"2026032712065759900_ref095","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1063\/1.1730361","article-title":"Statistical mechanics of rigid spheres","volume":"31","author":"Reiss","year":"1959","journal-title":"Journal of Chemical Physics"},{"issue":"2","key":"2026032712065759900_ref096","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1007\/BF01019850","article-title":"Statistical thermodynamic formalism in the solution of information theory problems","volume":"3","author":"Reiss","year":"1971","journal-title":"Journal of Statistical Physics"},{"issue":"4","key":"2026032712065759900_ref097","doi-asserted-by":"crossref","first-page":"2514","DOI":"10.1063\/1.457011","article-title":"Hard spheres: Thermodynamics and geometry","volume":"91","author":"Reiss","year":"1989","journal-title":"Journal of Chemical Physics"},{"key":"2026032712065759900_ref098","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511791338","volume-title":"Modern Coding Theory","author":"Richardson","year":"2008"},{"issue":"6","key":"2026032712065759900_ref099","doi-asserted-by":"crossref","first-page":"1939","DOI":"10.1109\/18.340468","article-title":"A mapping approach to rate-distortion computation and analysis","volume":"40","author":"Rose","year":"1994","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref100","volume-title":"Statistical Mechanics: Rigorous Results","author":"Ruelle","year":"1989"},{"issue":"19","key":"2026032712065759900_ref101","doi-asserted-by":"crossref","first-page":"2968","DOI":"10.1103\/PhysRevLett.70.2968","article-title":"Finite temperature error-correcting codes","volume":"70","author":"Ruj\u00e1n","year":"1993","journal-title":"Physics Review Letters"},{"key":"2026032712065759900_ref102","volume-title":"University Physics","author":"Sears","year":"1976"},{"key":"2026032712065759900_ref103","volume-title":"Statistical Mechanics: Entropy, Order Parameters, and Complexity","author":"Sethna","year":"2007"},{"key":"2026032712065759900_ref104","volume-title":"Technical report","author":"Shental","year":"2005"},{"issue":"4","key":"2026032712065759900_ref105","doi-asserted-by":"crossref","DOI":"10.1109\/TIT.2008.917638","article-title":"Discrete input two-dimensional Gaussian channels with memory: Estimation and information rates via graphical models and statistical mechanics","volume":"54","author":"Shental","year":"2008","journal-title":"IEEE Transactions on Information Theory"},{"issue":"1","key":"2026032712065759900_ref106","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/TIT.1980.1056144","article-title":"Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy","volume":"IT-26","author":"Shore","year":"1980","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref107","article-title":"The Boltzmann\u2013Sinai ergodic hypothesis in full generality","author":"Simanyi","year":"2010"},{"key":"2026032712065759900_ref108","first-page":"260","volume-title":"Proceedings of ISIT 2010","author":"Merhav","year":"2010"},{"key":"2026032712065759900_ref109","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1038\/339693a0","article-title":"Spin-glass models as error-correcting codes","volume":"339","author":"Sourlas","year":"1989","journal-title":"Nature"},{"key":"2026032712065759900_ref110","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1209\/0295-5075\/25\/3\/001","article-title":"Spin glasses, error-correcting codes and finite-temperature decoding","volume":"25","author":"Sourlas","year":"1994","journal-title":"Europhysics Letters"},{"key":"2026032712065759900_ref111","first-page":"514","volume-title":"Proceedings of ISIT 2008","author":"Takeuchi","year":"2008"},{"issue":"4","key":"2026032712065759900_ref112","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1209\/epl\/i2001-00306-3","article-title":"Statistical mechanics of CDMA multiuser demodulation","volume":"54","author":"Tanaka","year":"2001","journal-title":"Europhysics Letters"},{"issue":"11","key":"2026032712065759900_ref113","doi-asserted-by":"crossref","first-page":"2888","DOI":"10.1109\/TIT.2002.804053","article-title":"A statistical-mechanics approach to large-system analysis of CDMA multiuser detectors","volume":"48","author":"Tanaka","year":"2002","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref114","doi-asserted-by":"crossref","DOI":"10.1088\/1742-5468\/2010\/05\/P05008","article-title":"Methods for calculating nonconcave entropies","author":"Touchette","year":"2010"},{"issue":"1","key":"2026032712065759900_ref115","doi-asserted-by":"crossref","DOI":"10.1561\/0100000001","article-title":"Random matrix theory and wireless communications","volume":"1","author":"Tulino","year":"2004","journal-title":"Foundations and Trends in Communications and Information Theory"},{"key":"2026032712065759900_ref116","doi-asserted-by":"crossref","first-page":"1093","DOI":"10.1088\/0305-4470\/18\/7\/018","article-title":"Critique of the replica trick","volume":"17","author":"Varbaarschot","year":"1985","journal-title":"Journal of Physics A: Mathamatical and General"},{"key":"2026032712065759900_ref117","volume-title":"Principles of Digital Communication and Coding","author":"Viterbi","year":"1979"},{"key":"2026032712065759900_ref118","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000001","article-title":"Graphical models, exponential families, and variational inference","volume":"1","author":"Wainwright","year":"2008","journal-title":"Foundations and Trends in Machine Learning"},{"key":"2026032712065759900_ref119","volume-title":"Principles of Communication Engineering","author":"Wozencraft","year":"1990"},{"issue":"4","key":"2026032712065759900_ref120","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1137\/0127048","article-title":"On the probability of buffer overflow under an arbitrary bounded input-output distribution","volume":"27","author":"Wyner","year":"1974","journal-title":"SIAM Journal on Applied Mathematics"},{"issue":"3","key":"2026032712065759900_ref121","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1103\/PhysRev.87.404","article-title":"Statistical theory of equations of state and phase transitions. I. Theory of condensation","volume":"87","author":"Yang","year":"1952","journal-title":"Physical Review"},{"key":"2026032712065759900_ref122","article-title":"lectures delivered at the Santa Fe Summer School on Complex Systems","volume-title":"Quenched Disorder: Understanding Glasses Using a Variational Principle and the Replica Method","author":"Yedidia","year":"1992"},{"issue":"7","key":"2026032712065759900_ref123","doi-asserted-by":"crossref","first-page":"2282","DOI":"10.1109\/TIT.2005.850085","article-title":"Constructing free energy approximations and generalized belief propagation algorithms","volume":"51","author":"Yedidia","year":"2005","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712065759900_ref124","volume-title":"Information Theory and Network Coding","author":"Yeung","year":"2002"},{"key":"2026032712065759900_ref125","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/978-3-7091-2730-8_4","volume-title":"Information Theory New Trends and Open Problems","author":"Zakai","year":"1975"},{"key":"2026032712065759900_ref126","article-title":"Another critique of the replica trick","author":"Zirnbauer","year":"1999"},{"issue":"3","key":"2026032712065759900_ref127","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1109\/TIT.1973.1055015","article-title":"On functionals satisfying a data-processing theorem","volume":"IT-19","author":"Ziv","year":"1973","journal-title":"IEEE Transactions on Information Theory"}],"container-title":["Foundations and Trends\u00ae in Communications and Information Theory"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/ftcit\/article-pdf\/6\/1-2\/1\/11153854\/0100000052en.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/www.emerald.com\/ftcit\/article-pdf\/6\/1-2\/1\/11153854\/0100000052en.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T14:10:35Z","timestamp":1777471835000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.emerald.com\/ftcit\/article\/6\/1-2\/1\/1332378\/Statistical-Physics-and-Information-Theory"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,12,13]]},"references-count":127,"journal-issue":{"issue":"1-2","published-print":{"date-parts":[[2010,12,13]]}},"URL":"https:\/\/doi.org\/10.1561\/0100000052","relation":{},"ISSN":["1567-2190","1567-2328"],"issn-type":[{"value":"1567-2190","type":"print"},{"value":"1567-2328","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,12,13]]}}}