{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:52:51Z","timestamp":1760241171693,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2019,12,1]],"date-time":"2019-12-01T00:00:00Z","timestamp":1575158400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100008398","name":"Villum Fonden","doi-asserted-by":"publisher","award":["10095"],"award-info":[{"award-number":["10095"]}],"id":[{"id":"10.13039\/100008398","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>In this paper, we introduce the zero-delay multiple-description problem, where an encoder constructs two descriptions and the decoders receive a subset of these descriptions. The encoder and decoders are causal and operate under the restriction of zero delay, which implies that at each time instance, the encoder must generate codewords that can be decoded by the decoders using only the current and past codewords. For the case of discrete-time stationary scalar Gauss\u2014Markov sources and quadratic distortion constraints, we present information-theoretic lower bounds on the average sum-rate in terms of the directed and mutual information rate between the source and the decoder reproductions. Furthermore, we show that the optimum test channel is in this case Gaussian, and it can be realized by a feedback coding scheme that utilizes prediction and correlated Gaussian noises. Operational achievable results are considered in the high-rate scenario using a simple differential pulse code modulation scheme with staggered quantizers. Using this scheme, we achieve operational rates within     0.415        bits   \/   sample   \/   description    of the theoretical lower bounds for varying description rates.<\/jats:p>","DOI":"10.3390\/e21121185","type":"journal-article","created":{"date-parts":[[2019,12,2]],"date-time":"2019-12-02T10:50:45Z","timestamp":1575283845000},"page":"1185","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Zero-Delay Multiple Descriptions of Stationary Scalar Gauss-Markov Sources"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4199-5222","authenticated-orcid":false,"given":"Andreas Jonas","family":"Fuglsig","sequence":"first","affiliation":[{"name":"Department of Electronic Systems, Aalborg University, 9000 Aalborg, Denmark"},{"name":"RTX A\/S, 9400 N\u00f8rresundby, Denmark"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3724-6114","authenticated-orcid":false,"given":"Jan","family":"\u00d8stergaard","sequence":"additional","affiliation":[{"name":"Section on Signal and Information Processing, Deparment of Electronic Systems, Aalborg University, 9000 Aalborg, Denmark"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1645","DOI":"10.1016\/j.future.2013.01.010","article-title":"Internet of Things (IoT): A Vision, Architectural Elements, and Future Directions","volume":"29","author":"Gubbi","year":"2013","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"\u00d8stergaard, J., Quevedo, D.E., and Jensen, J. (2009, January 19\u201324). Low delay moving-horizon multiple-description audio coding for wireless hearing aids. Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, Taipei, Taiwan.","DOI":"10.1109\/ICASSP.2009.4959510"},{"key":"ref_3","unstructured":"Krueger, H., and Vary, P. (2008, January 8\u201310). A New Approach for Low-Delay Joint-Stereo Coding. Proceedings of the ITG Conference on Voice Communication [8. ITG-Fachtagung], Aachen, Germany."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1014","DOI":"10.1109\/TSA.2005.853205","article-title":"Robust low-delay audio coding using multiple descriptions","volume":"13","author":"Schuller","year":"2005","journal-title":"IEEE Trans. Speech Audio Process."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1886","DOI":"10.1109\/TAC.2010.2098070","article-title":"A Framework for Control System Design Subject to Average Data-Rate Constraints","volume":"56","author":"Silva","year":"2011","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_6","unstructured":"Tatikonda, S.C. (2000). Control Under Communication constraints. [Ph.D. Thesis, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology]."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1549","DOI":"10.1109\/TAC.2004.834430","article-title":"Stochastic linear control over a communication channel","volume":"49","author":"Tatikonda","year":"2004","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"841","DOI":"10.1109\/JSTSP.2018.2855046","article-title":"Zero-Delay Rate Distortion via Filtering for Vector-Valued Gaussian Sources","volume":"12","author":"Stavrou","year":"2018","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/79.952806","article-title":"Multiple description coding: Compression meets the network","volume":"18","author":"Goyal","year":"2001","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1909","DOI":"10.1002\/j.1538-7305.1980.tb03344.x","article-title":"On a source-coding problem with two channels and three receivers","volume":"59","author":"Ozarow","year":"1980","journal-title":"Bell Syst. Tech. J."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1109\/TIT.1982.1056588","article-title":"Achievable rates for multiple descriptions","volume":"28","author":"Gamal","year":"1982","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5465","DOI":"10.1109\/TIT.2015.2513773","article-title":"Colored-Gaussian Multiple Descriptions: Spectral and Time-Domain Forms","volume":"62","author":"Kochman","year":"2016","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2036","DOI":"10.1109\/TIT.2002.1013142","article-title":"Optimal filter banks for multiple description coding: Analysis and synthesis","volume":"48","author":"Dragotti","year":"2002","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2868","DOI":"10.1109\/TIT.2009.2018178","article-title":"Multiple Description Coding for Stationary Gaussian Sources","volume":"55","author":"Chen","year":"2009","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Mehmetoglu, M.S., Akyol, E., and Rose, K. (2016, January 20\u201325). Analog multiple descriptions: A zero-delay source-channel coding approach. Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China.","DOI":"10.1109\/ICASSP.2016.7472402"},{"key":"ref_16","unstructured":"Stavrou, P.A., \u00d8stergaard, J., and Skoglund, M. (2018, January 12\u201315). On Zero-delay Source Coding of LTI Gauss-Markov Systems with Covariance Matrix Distortion Constraints. Proceedings of the 2018 European Control Conference (ECC), Limassol, Cyprus."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Derpich, M.S., and \u00d8stergaard, J. (2010). Improved upper bounds to the causal quadratic rate-distortion function for Gaussian stationary sources. IEEE Int. Symp. Inf. Theory, 76\u201380.","DOI":"10.1109\/ISIT.2010.5513282"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1109\/TIT.1982.1056552","article-title":"Causal source codes","volume":"28","author":"Neuhoff","year":"1982","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1896","DOI":"10.1109\/TAC.2016.2601148","article-title":"Semidefinite Programming Approach to Gaussian Sequential Rate-Distortion Trade-Offs","volume":"62","author":"Tanaka","year":"2017","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2171","DOI":"10.1109\/TAC.2015.2500658","article-title":"A Characterization of the Minimal Average Data Rate That Guarantees a Given Closed-Loop Performance Level","volume":"61","author":"Silva","year":"2016","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Barforooshan, M., \u00d8stergaard, J., and Stavrou, P.A. (2017, January 12\u201315). Achievable performance of zero-delay variable-rate coding in rate-constrained networked control systems with channel delay. Proceedings of the 2017 IEEE 56th Annual Conference on Decision and Control (CDC), Melbourne, VIC, Australia.","DOI":"10.1109\/CDC.2017.8264566"},{"key":"ref_22","unstructured":"Massey, J. (1990, January 27\u201330). Causality, feedback and directed information. Proceedings of the International Symposium on Information Theory and its applications (ISITA-90), Honolulu, HI, USA."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3180","DOI":"10.1109\/TIT.2011.2132950","article-title":"Analog Matching of Colored Sources to Colored Channels","volume":"57","author":"Kochman","year":"2011","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"4286","DOI":"10.1109\/TSP.2011.2159601","article-title":"Real-Time Perceptual Moving-Horizon Multiple-Description Audio Coding","volume":"59","author":"Quevedo","year":"2011","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, W., Vijayanagar, K.R., and Kim, J. (2011, January 17\u201319). Low-delay distributed multiple description coding for error-resilient video transmission. Proceedings of the IEEE 13th International Workshop on Multimedia Signal Processing, Hangzhou, China.","DOI":"10.1109\/MMSP.2011.6093823"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"\u00d8stergaard, J., and Quevedo, D. (2013, January 20\u201322). Multiple Description Coding for Closed Loop Systems over Erasure Channels. Proceedings of the 2013 Data Compression Conference, Snowbird, UT, USA.","DOI":"10.1109\/DCC.2013.39"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Fuglsig, A.J. (2019). Zero-Delay Multiple Descriptions of Stationary Scalar Gauss-Markov Sources Using Feedback. [Mater\u2019s Thesis, Department of Electronic Systems and Department of Mathematical Sciences, Aalborg University].","DOI":"10.3390\/e21121185"},{"key":"ref_28","unstructured":"Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, Wiley-Interscience. [wiley student ed.]."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TIT.1976.1055508","article-title":"The rate-distortion function for source coding with side information at the decoder","volume":"22","author":"Wyner","year":"1976","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zamir, R. (2014). Lattice Coding for Signals and Networks, Cambridge University Press.","DOI":"10.1017\/CBO9781139045520"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2629","DOI":"10.1109\/18.796418","article-title":"Gaussian codes and Shannon bounds for multiple descriptions","volume":"45","author":"Zamir","year":"1999","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"5197","DOI":"10.1109\/TIT.2006.885498","article-title":"Multiple Description Quantization Via Gram-Schmidt Orthogonalization","volume":"52","author":"Chen","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_33","unstructured":"Berger, T. (1971). Rate Distortion Theory: A Mathematical Basis for Data Compression, Prentice Hall."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Madsen, H., and Thyregod, P. (2011). Introduction to General and Generalized Linear Models, CRC Press. Chapman & Hall\/CRC Texts in Statistical Science.","DOI":"10.1201\/9781439891148"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2133","DOI":"10.1109\/TIT.2007.896880","article-title":"Vector Gaussian Multiple Description With Individual and Central Receivers","volume":"53","author":"Wang","year":"2007","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"\u00d8stergaard, J., Kochman, Y., and Zamir, R. (2017, January 4\u20137). An Asymmetric Difference Multiple Description Gaussian Noise Channel. Proceedings of the 2017 Data Compression Conference (DCC), Snowbird, UT, USA.","DOI":"10.1109\/DCC.2017.16"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4661","DOI":"10.1109\/TIT.2009.2027528","article-title":"Multiple-Description Coding by Dithered Delta\u2014Sigma Quantization","volume":"55","author":"Zamir","year":"2009","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1109\/18.256491","article-title":"Design of multiple description scalar quantizers","volume":"39","author":"Vaishampayan","year":"1993","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1109\/TIP.2009.2013068","article-title":"Multiple Description Coding With Prediction Compensation","volume":"18","author":"Sun","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1109\/LSP.2005.843764","article-title":"A new class of multiple description scalar quantizer and its application to image coding","volume":"12","author":"Chao","year":"2005","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Samarawickrama, U., and Liang, J. (2008, January 4\u20137). A two-stage algorithm for multiple description predictive coding. Proceedings of the Canadian Conference on Electrical and Computer Engineering, Niagara Falls, ON, Canada.","DOI":"10.1109\/CCECE.2008.4564622"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1109\/18.971748","article-title":"Dithered lattice-based quantizers for multiple descriptions","volume":"48","author":"Zamir","year":"2002","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_43","unstructured":"Diggavi, S.N., and Vaishampayan, V.A. (2004, January 24\u201329). On multiple description source coding with decoder side information. Proceedings of the Information Theory Workshop, San Antonio, TX, USA."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Taubman, D.S. (2002). JPEG2000 Image Compression Fundamentals: Standards and Practice, Kluwer.","DOI":"10.1007\/978-1-4615-0799-4"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Massey, J.L., and Massey, P.C. (2005, January 4\u20139). Conservation of mutual and directed information. Proceedings of the International Symposium on Information Theory, ISIT, Adelaide, SA, Australia.","DOI":"10.1109\/ISIT.2005.1523313"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ihara, S. (1993). Information Theory for Continuous Systems, World Scientific Publishing Inc.","DOI":"10.1142\/9789814355827"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/12\/1185\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:39:02Z","timestamp":1760189942000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/12\/1185"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,1]]},"references-count":46,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["e21121185"],"URL":"https:\/\/doi.org\/10.3390\/e21121185","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2019,12,1]]}}}