{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:31:17Z","timestamp":1760243477316,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2013,5,31]],"date-time":"2013-05-31T00:00:00Z","timestamp":1369958400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Communication of a multivariate Gaussian source transmitted over orthogonal additive white Gaussian noise channels using delay-free joint source channel codes (JSCC) is studied in this paper. Two scenarios are considered: (1) all components of the multivariate Gaussian are transmitted by one encoder as a vector or several ideally collaborating nodes in a network; (2) the multivariate Gaussian is transmitted through distributed nodes in a sensor network. In both scenarios, the goal is to recover all components of the multivariate Gaussian at the receiver. The paper investigates a subset of JSCC consisting of direct source-to-channel mappings that operate on a symbol-by-symbol basis to ensure zero coding delay. A theoretical analysis that helps explain and quantify distortion behavior for such JSCC is given. Relevant performance bounds for the network are also derived with no constraints on complexity and delay. Optimal linear schemes for both scenarios are presented. Results for Scenario 1 show that linear mappings perform well, except when correlation is high. In Scenario 2, linear mappings provide no gain from correlation when the channel signal-to-noise ratio (SNR) gets large. The gap to the performance upper bound is large for both scenarios, regardless of SNR, when the correlation is high. The main contribution of this paper is the investigation of nonlinear mappings for both scenarios. It is shown that nonlinear mappings can provide substantial gain compared to optimal linear schemes when correlation is high. Contrary to linear mappings for Scenario 2, carefully chosen nonlinear mappings provide a gain for all SNR, as long as the correlation is close to one. Both linear and nonlinear mappings are robust against variations in SNR.<\/jats:p>","DOI":"10.3390\/e15062129","type":"journal-article","created":{"date-parts":[[2013,5,31]],"date-time":"2013-05-31T11:20:36Z","timestamp":1369999236000},"page":"2129-2161","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Zero Delay Joint Source Channel Coding for Multivariate Gaussian Sources over Orthogonal Gaussian Channels"],"prefix":"10.3390","volume":"15","author":[{"given":"P\u00e5l","family":"Floor","sequence":"first","affiliation":[{"name":"Intervention Center, Oslo University Hospital and Institute of Clinical Medicine, University of Oslo,0372 Oslo, Norway"},{"name":"Department of Electronics and Telecommunication, Norwegian University of Science and Technology (NTNU), 7491 Trondheim, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anna","family":"Kim","sequence":"additional","affiliation":[{"name":"SINTEF ICT, Forskningsveien 1, 0314 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tor","family":"Ramstad","sequence":"additional","affiliation":[{"name":"Department of Electronics and Telecommunication, Norwegian University of Science and Technology (NTNU), 7491 Trondheim, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ilangko","family":"Balasingham","sequence":"additional","affiliation":[{"name":"Intervention Center, Oslo University Hospital and Institute of Clinical Medicine, University of Oslo,0372 Oslo, Norway"},{"name":"Department of Electronics and Telecommunication, Norwegian University of Science and Technology (NTNU), 7491 Trondheim, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2013,5,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1109\/TIT.1973.1055037","article-title":"Noiseless coding of correlated information sources","volume":"19","author":"Slepian","year":"1973","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_2","unstructured":"Berger, T. (1971). Rate Distortion Theory: A Mathematical Basis for Data Compression, Prentice-Hall."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1057","DOI":"10.1109\/18.669162","article-title":"The rate-distortion function for the quadratic Gaussian CEO problem","volume":"44","author":"Oohama","year":"1998","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1912","DOI":"10.1109\/18.641555","article-title":"Gaussian multiterminal source coding","volume":"43","author":"Oohama","year":"1997","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1938","DOI":"10.1109\/TIT.2008.920343","article-title":"Rate region of the quadratic Gaussian two-encoder source-coding problem","volume":"54","author":"Wagner","year":"2008","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Oohama, Y. (2010). Distributed source coding for correlated memoryless Gaussian sources, arXiv:0908.3982v4 [cs.IT].","DOI":"10.1109\/ISIT.2010.5513292"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ray, S., Medard, M., Effros, M., and Kotter, R. (2006, January 22\u201326). On separation for multiple access channel. Proceedings of IEEE Information Theory Workshop, Chengdu, China.","DOI":"10.1109\/ITW.2006.322847"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2932","DOI":"10.1109\/TCOMM.2009.10.080230","article-title":"Nonlinear coding and estimation for correlated data in wireless sensor networks","volume":"57","author":"Wernersson","year":"2009","journal-title":"IEEE Trans. Commun."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1693","DOI":"10.1109\/TCOMM.2009.06.070482","article-title":"Distributed quantization over noisy channels","volume":"57","author":"Wernersson","year":"2009","journal-title":"IEEE Trans. Commun."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Karlsson, J., and Skoglund, M. (2011, January 5\u20139). Lattice-based source-channel coding in wireless sensor networks. Proceedings of IEEE International Conferece on Communications, Kyoto, Japan.","DOI":"10.1109\/icc.2011.5962670"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Akyol, E., Rose, K., and Ramstad, T.A. (2010, January 24\u201326). Optimized analog mappings for distributed source-channel coding. Proceedings of IEEE Data Compression Conference, Snowbird, Utah, USA.","DOI":"10.1109\/DCC.2010.92"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5177","DOI":"10.1109\/TIT.2006.885449","article-title":"The distributed Karhunen-Loeve transform","volume":"52","author":"Gastpar","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Rajesh, R., and Sharma, N. (2008, January 7\u201310). Correlated Gaussian sources over orthogonal Gaussian channels. Proceedings of International Symposium on Information Theory and its Applications, Auckland, New Zealand.","DOI":"10.1109\/ISITA.2008.4895633"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2714","DOI":"10.1109\/TIT.2010.2044058","article-title":"Sending a bi-variate Gaussian over a Gaussian MAC","volume":"60","author":"Lapidoth","year":"2010","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3091","DOI":"10.1109\/TCOMM.2012.071912.110456","article-title":"Zero-delay joint source-channel coding for a bi-variate Gaussian on a Gaussian MAC","volume":"60","author":"Floor","year":"2012","journal-title":"IEEE Trans. Commun."},{"key":"ref_16","unstructured":"Vaishampayan, V.A. (1989). Combined source-channel coding for bandlimited waveform channels. [Ph.D. dissertation, University of Maryland]."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/JRPROC.1949.232969","article-title":"Communication in the presence of noise","volume":"37","author":"Shannon","year":"1949","journal-title":"Proc. IRE"},{"key":"ref_18","unstructured":"Kotel\u2019nikov, V.A. (1959). The Theory of Optimum Noise Imunity, McGraw-Hill Book Company."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"558","DOI":"10.1109\/TIT.1965.1053821","article-title":"Theoretical limitations on the transmission from analog sources","volume":"11","author":"Goblick","year":"1965","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_20","first-page":"431","article-title":"Performance evaluation of a new modulation technique","volume":"16","author":"McRae","year":"1970","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1109\/TIT.1970.1054507","article-title":"Design of signals for analog communication","volume":"16","author":"Timor","year":"1970","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1109\/TCOM.1975.1092849","article-title":"Hybrid amplitude-and-phase modulation for analog data transmission","volume":"23","author":"Thomas","year":"1976","journal-title":"IEEE Trans. Commun."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1283","DOI":"10.1109\/TCOM.1976.1093255","article-title":"Optimal linear coding for vector channels","volume":"24","author":"Lee","year":"1976","journal-title":"IEEE Trans. Commun."},{"key":"ref_24","unstructured":"Fuldseth, A., and Ramstad, T.A. (1997, January 21\u201324). Bandwidth compression for continuous amplitude channels based on vector approximation to a continuous subset of the signal space. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, Atlanta, GA, USA."},{"key":"ref_25","unstructured":"Coward, H., and Ramstad, T.A. (2000, January 5\u20139). Quantizer optimization in hybrid digital-analog transmission of analog source signals. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, Istanbul, Turkey."},{"key":"ref_26","unstructured":"Chung, S.Y. (2000). On the construction of some capacity-approaching coding schemes. [Ph.D. dissertation, Massachusetts Institute of Technology]."},{"key":"ref_27","first-page":"114","article-title":"Shannon mappings for robust comunication","volume":"98","author":"Ramstad","year":"2002","journal-title":"Telektronikk"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1082","DOI":"10.1109\/18.995544","article-title":"Hybrid digital-analog (HDA) joint source-chanel codes for broadcasting and robust communications","volume":"48","author":"Mittal","year":"2002","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TIT.2003.810631","article-title":"To code, or not to code: Lossy source-channel communication revisited","volume":"49","author":"Gastpar","year":"2003","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3757","DOI":"10.1109\/TIT.2006.878212","article-title":"Hybrid digital-analog source-chanel coding for bandwidth compression\/expansion","volume":"52","author":"Skoglund","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/TCOMM.2009.0901.070075","article-title":"Shannon-Kotel\u2019nikov mappings in joint source-channel coding","volume":"57","author":"Hekland","year":"2009","journal-title":"IEEE Trans. Commun."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Floor, P.A., and Ramstad, T.A. (2007, January 2\u20136). Optimality of dimension expanding Shannon-Kotel\u2019nikov mappings. Proceedings of IEEE Information Theory Workshop, Tahoe City, CA, USA.","DOI":"10.1109\/ITW.2007.4313089"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Cai, X., and Modestino, J.W. (2006, January 22\u201324). Bandwidth expansion Shannon mapping for analog error-control coding. Proceedings of IEEE Conference on Information Sciences and Systems, Princeton University, Princeton, NJ, USA.","DOI":"10.1109\/CISS.2006.286411"},{"key":"ref_34","unstructured":"Akyol, E., Rose, K., and Ramstad, T.A. (September, January 30). Optimal mappings for joint source channel coding. Proceedings of IEEE Information Theory Workshop, Dublin, Ireland."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3016","DOI":"10.1109\/TCOMM.2011.081711.090298","article-title":"Analog joint source-channel coding using non-linear curves and MMSE decoding","volume":"59","author":"Hu","year":"2011","journal-title":"IEEE Trans. Commun."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"5880","DOI":"10.1109\/TSP.2012.2212887","article-title":"Multiple description analog joint source-chanel coding to exploit the diversity in parallel channels","volume":"60","author":"Erdozain","year":"2012","journal-title":"IEEE Trans. Signal Proc."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3180","DOI":"10.1109\/TIT.2011.2132950","article-title":"Analog matching of colored sources to colored channels","volume":"57","author":"Kochman","year":"2011","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_38","unstructured":"Floor, P.A., and Ramstad, T.A. (2012). Shannon-Kotel\u2019nikov mappings for analog point-to-point communications, arXiv:1101.5716v2 [cs.IT]."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Kim, A., Floor, P.A., Ramstad, T.A., and Balasingham, I. (2011, January 5\u20139). Delay-free joint source-channel coding for Gaussian network of multiple sensors. Proceedings of IEEE International Conferece on Communications, Kyoto, Japan.","DOI":"10.1109\/icc.2011.5962669"},{"key":"ref_40","unstructured":"Wozencraft, J.M., and Jacobs, I.M. (1965). Principles of Communication Engineering, John Wiley & Sons."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Floor, P.A., and Ramstad, T.A. (2006, January 7\u20139). Dimension reducing mappings in joint source-channel coding. Proceedings of IEEE Nordic Signal Processing Symposium, Reykjavik, Iceland.","DOI":"10.1109\/NORSIG.2006.275256"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Saleh, A.A., Alajaji, F., and Chan, W.Y. (2011, January 17\u201320). Hybrid digital-analog source-channel coding with one-to-three bandwidth expansion. Proceedings of IEEE Canadian Workshop in Information Theory, Kelowna, Canada.","DOI":"10.1109\/CWIT.2011.5872126"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"7000","DOI":"10.1109\/TIT.2011.2165824","article-title":"Threshold effects in parameter estimation as phase transitions in statistical mechanics","volume":"57","author":"Merhav","year":"2011","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_44","unstructured":"Cram\u00e9r, H. (1951). Mathematical Methods of Statistics, Princeton University Press."},{"key":"ref_45","unstructured":"Cover, T.A., and Thomas, J.A. (1991). Elements of Information Theory, John Wiely & Sons."},{"key":"ref_46","unstructured":"Papoulis, A., and Pillai, S.U. (2002). Probability, Random Variables and Stochastic Processes, McGraw-Hill."},{"key":"ref_47","unstructured":"Gasquet, C., and Witomski, P. (1999). Fourier Analysis and Applications, Springer-Verlag."},{"key":"ref_48","unstructured":"Sakrison, D.J. (1968). Communication Theory: Transmission of Waveforms and Digital Infromation, John Wiley & Sons."},{"key":"ref_49","unstructured":"Edwards, C.H., and Penney, D.E. (1998). Calculus with Analytic Geometry, Prentice Hall International Inc."},{"key":"ref_50","unstructured":"Spivak, M. (1999). A Comprehensive Introduction to Differential Geometry, Publish or Perish."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/15\/6\/2129\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:47:07Z","timestamp":1760219227000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/15\/6\/2129"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,5,31]]},"references-count":50,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2013,6]]}},"alternative-id":["e15062129"],"URL":"https:\/\/doi.org\/10.3390\/e15062129","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2013,5,31]]}}}