{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:14:28Z","timestamp":1760242468505,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2017,9,2]],"date-time":"2017-09-02T00:00:00Z","timestamp":1504310400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Let      (  S  1 , i   ,  S  2 , i   )  \u223c  i . i . d   p  (  s 1  ,  s 2  )     ,     i = 1 , 2 , \u22ef     be a memoryless, correlated partial side information sequence. In this work, we study channel coding and source coding problems where the partial side information     (  S 1  ,  S 2  )     is available at the encoder and the decoder, respectively, and, additionally, either the encoder\u2019s or the decoder\u2019s side information is increased by a limited-rate description of the other\u2019s partial side information. We derive six special cases of channel coding and source coding problems and we characterize the capacity and the rate-distortion functions for the different cases. We present a duality between the channel capacity and the rate-distortion cases we study. In order to find numerical solutions for our channel capacity and rate-distortion problems, we use the Blahut-Arimoto algorithm and convex optimization tools. Finally, we provide several examples corresponding to the channel capacity and the rate-distortion cases we presented.<\/jats:p>","DOI":"10.3390\/e19090467","type":"journal-article","created":{"date-parts":[[2017,9,4]],"date-time":"2017-09-04T11:11:52Z","timestamp":1504523512000},"page":"467","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Channel Coding and Source Coding With Increased Partial Side Information"],"prefix":"10.3390","volume":"19","author":[{"given":"Avihay","family":"Sadeh-Shirazi","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering at the Ben Gurion University of the Negev, Beer Sheva 84105, Israel"}]},{"given":"Uria","family":"Basher","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering at the Ben Gurion University of the Negev, Beer Sheva 84105, Israel"}]},{"given":"Haim","family":"Permuter","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering at the Ben Gurion University of the Negev, Beer Sheva 84105, Israel"}]}],"member":"1968","published-online":{"date-parts":[[2017,9,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4283","DOI":"10.1109\/TIT.2008.928295","article-title":"Coding for Channels With Rate-Limited Side Information at the Decoder, with Applications","volume":"54","author":"Steinberg","year":"2008","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_2","first-page":"19","article-title":"Coding for Channel with Random Parameters","volume":"9","author":"Pinsker","year":"1980","journal-title":"Probl. Control Theory"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TIT.1976.1055508","article-title":"The rate-distortion function for source coding with side information at the decoder","volume":"22","author":"Wyner","year":"1976","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1147\/rd.24.0289","article-title":"Channels with side information at the transmitter","volume":"2","author":"Shannon","year":"1958","journal-title":"IBM J. Res. Dev."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1109\/TIT.1983.1056723","article-title":"On the capacity of computer memory with defects","volume":"29","author":"Heegard","year":"1983","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1629","DOI":"10.1109\/TIT.2002.1003843","article-title":"Duality between channel capacity and rate distortion with two-sided state information","volume":"48","author":"Cover","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1817","DOI":"10.1109\/TIT.2005.846422","article-title":"On channels with partial channel state information at the transmitter","volume":"51","author":"Rosenzweig","year":"2005","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4521","DOI":"10.1109\/TIT.2007.909165","article-title":"Coding Problems for Channels With Partial State Information at the Transmitter","volume":"53","author":"Cemal","year":"2007","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1561\/0100000025","article-title":"Channel Coding in the Presence of Side Information","volume":"4","author":"Keshet","year":"2007","journal-title":"Found. Trends Commun. Inf. Theory"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1109\/TIT.1985.1057118","article-title":"Two-way source coding with a fidelity criterion","volume":"31","author":"Kaspi","year":"1985","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2905","DOI":"10.1109\/TIT.2010.2046238","article-title":"Two-Way Source Coding With a Helper","volume":"56","author":"Permuter","year":"2010","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5218","DOI":"10.1109\/TIT.2006.885500","article-title":"Source Coding With Limited-Look-Ahead Side Information at the Decoder","volume":"52","author":"Weissman","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4003","DOI":"10.1109\/TIT.2005.856978","article-title":"On causal source codes with side information","volume":"51","author":"Weissman","year":"2005","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_14","first-page":"142","article-title":"Coding Theorems for a Discrete Source with a Fidelity Criterion","volume":"4","author":"Shannon","year":"1959","journal-title":"IRE Nat. Conv. Rec."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1181","DOI":"10.1109\/TIT.2003.810622","article-title":"Duality between source coding and channel coding and its extension to the side information case","volume":"49","author":"Pradhan","year":"2003","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2986","DOI":"10.1109\/TIT.2006.876355","article-title":"On functional duality in multiuser source and channel coding problems with one-sided collaboration","volume":"52","author":"Pradhan","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1250","DOI":"10.1109\/TIT.2002.1003821","article-title":"Nested linear\/lattice codes for structured multiterminal binning","volume":"48","author":"Zamir","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_18","unstructured":"Su, J., Eggers, J., and Girod, B. (November, January 29). Illustration of the duality between channel coding and rate distortion with side information. Proceedings of the 2000 Conference Record of the Thirty-Fourth Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2285","DOI":"10.1109\/TIT.2016.2533479","article-title":"Duality of a Source Coding Problem and the Semi-Deterministic Broadcast Channel With Rate-Limited Cooperation","volume":"62","author":"Goldfeld","year":"2016","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"5511","DOI":"10.1109\/TIT.2013.2266655","article-title":"Successive Refinement With Decoder Cooperation and Its Channel Coding Duals","volume":"59","author":"Asnani","year":"2013","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3171","DOI":"10.1109\/TIT.2011.2136910","article-title":"Operational Duality Between Lossy Compression and Channel Coding","volume":"57","author":"Gupta","year":"2011","journal-title":"IEEE Trans. Inf. Theor."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1109\/TIT.1972.1054855","article-title":"Computation of channel capacity and rate-distortion functions","volume":"18","author":"Blahut","year":"1972","journal-title":"IEEE Trans. Inform. Theory"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/TIT.1972.1054753","article-title":"An Algorithm for Computing the Capacity of Arbitrary Discrete MemorylessChannels","volume":"18","author":"Arimoto","year":"1972","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_24","unstructured":"Willems, F.M.J. (1983). Computation of the Wyner-Ziv Rate-Distortion Function, University of Technology. Research Report."},{"key":"ref_25","unstructured":"Dupuis, F., Yu, W., and Willems, F. (July, January 27). Blahut-Arimoto algorithms for computing channel capacity and rate-distortion with side information. Proceedings of the 2004 International Symposium on Information Theory, Chicago, IL, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"4418","DOI":"10.1109\/TIT.2005.859248","article-title":"Computing the channel capacity and rate-distortion function with two-sided state information","volume":"51","author":"Cheng","year":"2005","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sumszyk, O., and Steinberg, Y. (July, January 28). Information embedding with reversible stegotext. Proceedings of the 2009 IEEE International Symposium on Information Theory, Seoul, Korea.","DOI":"10.1109\/ISIT.2009.5205855"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1109\/TIT.2012.2214202","article-title":"Extension of the Blahut-Arimoto Algorithm for Maximizing Directed Information","volume":"59","author":"Naiss","year":"2013","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_29","unstructured":"Cover, T.M., and Thomas, J.A. (1991). Elements of Information Theory, John Wiley & Sons."},{"key":"ref_30","unstructured":"Yeung, R.W. (2008). Information Theory and Network Coding, Springer. [1 ed.]."},{"key":"ref_31","unstructured":"Longo, G. (1978). Multiterminal source coding. Information Theory Approach to Communications, Springer. CSIM Course and Lectures."},{"key":"ref_32","unstructured":"Csiszar, I., and Korner, J. (1981). Information Theory: Coding Theorems for Discrete Memoryless Systems\/Imre Csiszar and Janos Korner, Academic Press."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/9\/467\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:43:59Z","timestamp":1760208239000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/9\/467"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,2]]},"references-count":32,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2017,9]]}},"alternative-id":["e19090467"],"URL":"https:\/\/doi.org\/10.3390\/e19090467","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2017,9,2]]}}}