{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:34:48Z","timestamp":1760243688971,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2022,9,1]],"date-time":"2022-09-01T00:00:00Z","timestamp":1661990400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Regional Development Fund","award":["EXCELLENCE\/1216\/0296"],"award-info":[{"award-number":["EXCELLENCE\/1216\/0296"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Examined in this paper is the Gray and Wyner source coding for a simple network of correlated multivariate Gaussian random variables, Y1:\u03a9\u2192Rp1 and Y2:\u03a9\u2192Rp2. The network consists of an encoder that produces two private rates R1 and R2, and a common rate R0, and two decoders, where decoder 1 receives rates (R1,R0) and reproduces Y1 by Y^1, and decoder 2 receives rates (R2,R0) and reproduces Y2 by Y^2, with mean-square error distortions E||Yi\u2212Y^i||Rpi2\u2264\u0394i\u2208[0,\u221e],i=1,2. Use is made of the weak stochastic realization and the geometric approach of such random variables to derive test channel distributions, which characterize the rates that lie on the Gray and Wyner rate region. Specific new results include: (1) A proof that, among all continuous or finite-valued random variables, W:\u03a9\u2192W, Wyner\u2019s common information, C(Y1,Y2)=infPY1,Y2,W:PY1,Y2|W=PY1|WPY2|WI(Y1,Y2;W), is achieved by a Gaussian random variable, W:\u03a9\u2192Rn of minimum dimension n, which makes the two components of the tuple (Y1,Y2) conditionally independent according to the weak stochastic realization of (Y1,Y2), and a the formula C(Y1,Y2)=12\u2211j=1nln1+dj1\u2212dj, where di\u2208(0,1),i=1,\u2026,n are the canonical correlation coefficients of the correlated parts of Y1 and Y2, and a realization of (Y1,Y2,W) which achieves this. (2) The parameterization of rates that lie on the Gray and Wyner rate region, and several of its subsets. The discussion is largely self-contained and proceeds from first principles, while connections to prior literature is discussed.<\/jats:p>","DOI":"10.3390\/e24091227","type":"journal-article","created":{"date-parts":[[2022,9,1]],"date-time":"2022-09-01T21:27:17Z","timestamp":1662067637000},"page":"1227","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Realization Approach to Lossy Network Compression of a Tuple of Correlated Multivariate Gaussian RVs"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2168-0231","authenticated-orcid":false,"given":"Charalambos D.","family":"Charalambous","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Cyprus, P.O. Box 20537, CY-1678 Nicosia, Cyprus"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7150-7915","authenticated-orcid":false,"given":"Jan H.","family":"van Schuppen","sequence":"additional","affiliation":[{"name":"Van Schuppen Control Research, Gouden Leeuw 143, 1103 KB Amsterdam, The Netherlands"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1681","DOI":"10.1002\/j.1538-7305.1974.tb02812.x","article-title":"Source coding for a simple network","volume":"53","author":"Gray","year":"1974","journal-title":"Bell Syst. Tech. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1109\/TIT.1975.1055346","article-title":"The common information of two dependent random variables","volume":"21","author":"Wyner","year":"1975","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1137\/0131026","article-title":"Values and bounds for common information of two discrete variables","volume":"31","author":"Witsenhausen","year":"1976","journal-title":"SIAM J. Appl. Math."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1137\/0128010","article-title":"On sequences of pairs of dependent random variables","volume":"28","author":"Witsenhausen","year":"1975","journal-title":"SIAM J. Appl. Math."},{"key":"ref_5","first-page":"149","article-title":"Common information is much less than mutual information","volume":"2","author":"Gacs","year":"1973","journal-title":"Probl. Control Inf. Theory"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Benammar, M., and Zaidi, A. (2018). Rate-distortion region of a Gray-Wyner model with side information. Entropy, 20.","DOI":"10.3390\/e20010002"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Benammar, M., and Zaidi, A. (2017, January 25\u201330). Rate-distortion region of a Gray-Wyner problem with side information. Proceedings of the IEEE International Symposium on Information Theory (ISIT.2017), Aachen, Germany.","DOI":"10.1109\/ISIT.2017.8006499"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5080","DOI":"10.1109\/TIT.2016.2586919","article-title":"Rate-distortion function for a Heegard-Berger problem with two sources and degraded reconstruction sets","volume":"62","author":"Benammar","year":"2016","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Benammar, M., and Zaidi, A. (2015, January 11\u201315). Rate-distortion function for a Heegard-Berger problem with common reconstruction constraint. Proceedings of the IEEE International Theory Workshop (ITW.2015), Jeju Island, Korea.","DOI":"10.1109\/ITWF.2015.7360793"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1109\/TIT.1985.1057103","article-title":"Rate distortion when side information may be absent","volume":"31","author":"Heegard","year":"1985","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4181","DOI":"10.1109\/TIT.2010.2054651","article-title":"Coordination Capacity","volume":"56","author":"Cuff","year":"2010","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3238","DOI":"10.1109\/TIT.2014.2315805","article-title":"The lossy common information of correlated sources","volume":"60","author":"Kumar","year":"2014","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1109\/TIT.2015.2506560","article-title":"A lossy source coding interpretation of Wyner\u2019s common information","volume":"62","author":"Xu","year":"2016","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_14","unstructured":"Xiao, J.-J., and Luo, Z.-Q. (2005, January 28\u201330). Compression of Correlated Gaussian Sources under Individual Distortion Criteria. Proceedings of the 43rd Annual Allerton Conference on Communication, Control and Computing, Monticello, IL, USA."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Satpathy, S., and Cuff, P. (2015, January 14\u201319). Gaussian secure source coding and Wyner\u2019s common information. Proceedings of the IEEE International Symposium on Information Theory (ISIT.2015), Hong Kong, China.","DOI":"10.1109\/ISIT.2015.7282428"},{"key":"ref_16","unstructured":"Veld, G.J.O., and Gastpar, M.C. (2016, January 27\u201330). Total correlation of Gaussian vector sources on the Gray-Wyner network. Proceedings of the 54th Annual Allerton Conference on Communication, Control and Computing (Allerton), Monticello, IL, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sula, E., and Gastpar, M. (2019). Relaxed Wyner\u2019s common information. arXiv.","DOI":"10.1109\/ITW44776.2019.8989086"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1093\/biomet\/28.3-4.321","article-title":"Relation between two sets of variates","volume":"28","author":"Hotelling","year":"1936","journal-title":"Biometrika"},{"key":"ref_19","first-page":"199","article-title":"Calculation of the amount of information about a random function contained in another such function","volume":"2","author":"Gelfand","year":"1959","journal-title":"Am. Math. Soc. Transl."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"van Schuppen, J.H., and Villa, T. (2015). Common, correlated, and private information in control of decentralized systems. Coordination Control of Distributed Systems, Springer International Publishing. Number 456 in Lecture Notes in Control and Information Sciences.","DOI":"10.1007\/978-3-319-10407-2_26"},{"key":"ref_21","unstructured":"Charalambous, C.D., and van Schuppen, J.H. (2019). A new approach to lossy network compression of a tuple of correlated multivariate Gaussian RVs. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/0047-259X(83)90008-8","article-title":"The weak and strong Gaussian probabilistic realization problem","volume":"13","year":"1983","journal-title":"J. Multivar. Anal."},{"key":"ref_23","unstructured":"Noble, B. (1969). Applied Linear Algebra, Prentice-Hall."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Stylianou, E., Charalambous, C.D., and Charalambous, T. (2021, January 12\u201320). Joint rate distortion function of a tuple of correlated multivariate Gaussian sources with individual fidelity criteria. Proceedings of the 2021 IEEE International Symposium on Information Theory (ISIT.2021), Melbourne, Australia.","DOI":"10.1109\/ISIT45174.2021.9518279"},{"key":"ref_25","unstructured":"Gkagkos, M., and Charalambous, C.D. (2020). Structural properties of optimal test channels for distributed source coding with decoder side information for multivariate Gaussian sources with square-error fidelity. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gkangos, M., and Charalambous, C.D. (2021, January 12\u201320). Structural properties of test channels of the RDF for Gaussian multivariate distributed sources. Proceedings of the 2021 IEEE International Symposium on Information Theory (ISIT.2021), Melbourne, Australia.","DOI":"10.1109\/ISIT45174.2021.9517719"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Charalambous, C.D., and van Schuppen, J.H. (2020, January 21\u201326). Characterization of conditional independence and weak realizations of multivariate gaussian random variables: Applications to networks. Proceedings of the IEEE International Symposium on Information Theory (ISIT.2020), Los Angeles, CA, USA.","DOI":"10.1109\/ISIT44484.2020.9174403"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1109\/TIT.1973.1055050","article-title":"A new class of lower bounds to information rates of stationary via conditional rate-distortion functions","volume":"19","author":"Gray","year":"1973","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_29","unstructured":"Cover, T.M., and Thomas, J.A. (1991). Elements of Information Theory, John Wiley & Sons."},{"key":"ref_30","unstructured":"Gallager, R.G. (1968). Information Theory and Reliable Communication, John Wiley & Sons."},{"key":"ref_31","unstructured":"Yaglom, A.M., and Yaglom, I.M. (1983). Probability and Information, D. Reidel Publishing Company."},{"key":"ref_32","unstructured":"Marshall, A.W., and Olkin, I. (1979). Inequalities: Theory of Majorization and Its Applications, Academic Press."},{"key":"ref_33","first-page":"463","article-title":"Inequalies involving determinants","volume":"5","author":"Hua","year":"1955","journal-title":"Acta Math. Sin."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhang, F. (2011). Positive semidefinite matrices. Matrix Theory: Basic Results and Techniques, Springer Science+Business Media.","DOI":"10.1007\/978-1-4614-1099-7_7"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/9\/1227\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:21:52Z","timestamp":1760142112000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/9\/1227"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,1]]},"references-count":34,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["e24091227"],"URL":"https:\/\/doi.org\/10.3390\/e24091227","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,9,1]]}}}