{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:15:05Z","timestamp":1760242505679,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2017,9,21]],"date-time":"2017-09-21T00:00:00Z","timestamp":1505952000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The Ka-band and higher Q\/V band channels can provide an appealing capacity for the future deep-space communications and Space Information Networks (SIN), which are viewed as a primary solution to satisfy the increasing demands for high data rate services. However, Ka-band channel is much more sensitive to the weather conditions than the conventional communication channels. Moreover, due to the huge distance and long propagation delay in SINs, the transmitter can only obtain delayed Channel State Information (CSI) from feedback. In this paper, the noise temperature of time-varying rain attenuation at Ka-band channels is modeled to a two-state Gilbert\u2013Elliot channel, to capture the channel capacity that randomly ranging from good to bad state. An optimal transmission scheme based on Partially Observable Markov Decision Processes (POMDP) is proposed, and the key thresholds for selecting the optimal transmission method in the SIN communications are derived. Simulation results show that our proposed scheme can effectively improve the throughput.<\/jats:p>","DOI":"10.3390\/e19100510","type":"journal-article","created":{"date-parts":[[2017,9,21]],"date-time":"2017-09-21T12:17:40Z","timestamp":1505996260000},"page":"510","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Partially Observable Markov Decision Process-Based Transmission Policy over Ka-Band Channels for Space Information Networks"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7988-9820","authenticated-orcid":false,"given":"Jian","family":"Jiao","sequence":"first","affiliation":[]},{"given":"Xindong","family":"Sui","sequence":"additional","affiliation":[]},{"given":"Shushi","family":"Gu","sequence":"additional","affiliation":[]},{"given":"Shaohua","family":"Wu","sequence":"additional","affiliation":[{"name":"Communication Engineering Research Centre, Harbin Institute of Technology Shenzhen, HIT Campus of University Town of Shenzhen, Shenzhen 518055, China"}]},{"given":"Qinyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Communication Engineering Research Centre, Harbin Institute of Technology Shenzhen, HIT Campus of University Town of Shenzhen, Shenzhen 518055, China"}]}],"member":"1968","published-online":{"date-parts":[[2017,9,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1109\/MWC.2016.1500108WC","article-title":"Broadband hybrid satellite-terrestrial communication systems based on cognitive radio toward 5G","volume":"23","author":"Jia","year":"2016","journal-title":"IEEE Wirel. Commun."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/COMST.2004.5342290","article-title":"Satellite communications at Ku, Ka, and V bands: Propagation impairments and mitigation techniques","volume":"6","author":"Panagopoulos","year":"2004","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1357","DOI":"10.1109\/TAES.2014.120110","article-title":"CFDP-based two-hop relaying protocol over weather-dependent Ka-band space channel","volume":"51","author":"Yang","year":"2015","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"doi-asserted-by":"crossref","unstructured":"Bell, D., Allen, S., and Chamberlain, N. (2014, January 1\u20138). MRO relay telecom support of Mars Science Laboratory surface operations. Proceedings of the IEEE Aerospace Conference, Big Sky, MT, USA.","key":"ref_4","DOI":"10.1109\/AERO.2014.6836170"},{"doi-asserted-by":"crossref","unstructured":"Craig, D., Herrmann, N., and Troutman, P. (2015, January 7\u201314). The evolvable Mars campaign-study status. Proceedings of the IEEE Aerospace Conference, Big Sky, MT, USA.","key":"ref_5","DOI":"10.1109\/AERO.2015.7118925"},{"doi-asserted-by":"crossref","unstructured":"Adams, N., Copeland, D., and Mick, A. (2014, January 1\u20138). Optimization of deep-space Ka-band link schedules. Proceedings of the IEEE Aerospace Conference, Big Sky, MT, USA.","key":"ref_6","DOI":"10.1109\/AERO.2014.6836351"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1109\/MCOM.2015.7060478","article-title":"Cognitive spectrum utilization in Ka band multibeam satellite communications","volume":"53","author":"Maleki","year":"2015","journal-title":"IEEE Commun. Mag."},{"doi-asserted-by":"crossref","unstructured":"Jiao, J., Yang, Y., Feng, B., Wu, S., Li, Y., and Zhang, Q. (2017). Distributed rateless codes with unequal error protection property for space information networks. Entropy, 19.","key":"ref_8","DOI":"10.3390\/e19010038"},{"doi-asserted-by":"crossref","unstructured":"Wang, Y., Jiao, J., Sui, X.D., Wu, S.H., Li, Y.H., and Zhang, Q.Y. (2016, January 13\u201315). Rateless coding scheme for time-varying dying channels. Proceedings of the 8th Wireless Communications & Signal Processing, Yangzhou, China.","key":"ref_9","DOI":"10.1109\/WCSP.2016.7752699"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/MAES.2011.5739483","article-title":"Packets interleaving CCSDS file delivery protocol in deep space communication","volume":"26","author":"Jiao","year":"2011","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1109\/MAES.2017.160118","article-title":"Integration of Reed-Solomon codes to Licklider transmission protocol (LTP) for space DTN","volume":"32","author":"Shi","year":"2017","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1109\/JSYST.2014.2330422","article-title":"Modeling RTT for DTN protocol over asymmetric cislunar space channels","volume":"10","author":"Yu","year":"2016","journal-title":"IEEE Syst. J."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2536","DOI":"10.1109\/TVT.2016.2572079","article-title":"Optimal RTO timer for best transmission efficiency of DTN protocol in deep-space vehicle communications","volume":"66","author":"Wang","year":"2017","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/MVT.2016.2594796","article-title":"Scoping contact graph-routing scalability: Investigating the system\u2019s usability in space-vehicle communication networks","volume":"11","author":"Wang","year":"2016","journal-title":"IEEE Veh. Technol. Mag."},{"doi-asserted-by":"crossref","unstructured":"Wu, H., Li, Y., Jiao, J., Cao, B., and Zhang, Q. (2016, January 26\u201328). LTP asynchronous accelerated retransmission strategy for deep space communications. Proceedings of the IEEE International Conference on Wireless for Space and Extreme Environments (WiSEE), Aachen, Germany.","key":"ref_15","DOI":"10.1109\/WiSEE.2016.7877312"},{"unstructured":"Gu, S., Jiao, J., Yang, Z., Zhang, Q., and Wang, Y. (2013, January 24\u201326). RCLTP: A rateless coding-based Licklider transmission protocol in space delay\/disrupt tolerant network. Proceedings of the Wireless Communications & Signal Processing, Hangzhou, China.","key":"ref_16"},{"doi-asserted-by":"crossref","unstructured":"Tang, J., Mansourifard, P., and Krishnamachari, B. (2013, January 9\u201313). Power allocation over two identical Gilbert\u2013Elliott channels. Proceedings of the IEEE International Conference on Communications (ICC), Budapest, Hungary.","key":"ref_17","DOI":"10.1109\/ICC.2013.6655538"},{"doi-asserted-by":"crossref","unstructured":"Jiang, W., Tang, J., and Krishnamachari, B. (2013, January 9\u201313). Optimal power allocation policy over two identical Gilbert\u2013Elliott channels. Proceedings of the IEEE International Conference on Communications (ICC), Budapest, Hungary.","key":"ref_18","DOI":"10.1109\/ICC.2013.6655539"},{"doi-asserted-by":"crossref","unstructured":"Li, J., Tang, J., and Krishnamachari, B. (2013, January 12). Optimal power allocation over multiple identical Gilbert\u2013Elliott channels. Proceedings of the IEEE Global Communications Conference (GLOBECOM), Atlanta, GA, USA.","key":"ref_19","DOI":"10.1109\/ICC.2013.6655538"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1272","DOI":"10.1109\/TCOMM.2014.020514.130592","article-title":"Reconfigurable antennas preemptive switching and virtual channel management","volume":"62","author":"Kumar","year":"2014","journal-title":"IEEE Trans. Commun."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1049\/iet-com.2014.1184","article-title":"Double retransmission deferred negative acknowledgement in Consultative Committee for Space Data Systems File Delivery Protocol for space communications","volume":"10","author":"Wu","year":"2016","journal-title":"IET Commun."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1049\/iet-com.2013.0488","article-title":"Network-coded rateless coding scheme in erasure multiple-access relay enabled communications","volume":"8","author":"Gu","year":"2014","journal-title":"IET Commun."},{"doi-asserted-by":"crossref","unstructured":"Chen, C., Jiao, J., Wu, H., Li, Y., and Zhang, Q. (2016, January 26\u201328). Adaptive rateless coding scheme for deep-space Ka-band communications. Proceedings of the IEEE International Conference on Wireless for Space and Extreme Environments (WiSEE), Aachen, Germany.","key":"ref_23","DOI":"10.1109\/WiSEE.2016.7877308"},{"doi-asserted-by":"crossref","unstructured":"Sung, I., and Gao, J. (2006, January 22). CFDP performance over weather-dependent Ka-band channel. Proceedings of the American Institute of Aeronautics and Astronautics Conference, Rome, Italy.","key":"ref_24","DOI":"10.2514\/6.2006-5968"},{"doi-asserted-by":"crossref","unstructured":"Gao, J. (2016, January 5\u201312). On the performance of adaptive data rate over deep space Ka-band link: Case study using Kepler data. Proceedings of the IEEE Aerospace Conference, Big Sky, MT, USA.","key":"ref_25","DOI":"10.1109\/AERO.2016.7500808"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"15414","DOI":"10.1109\/ACCESS.2017.2651742","article-title":"Interactive multiple model filter for land-mobile satellite communications at Ka-band","volume":"5","author":"Ferreira","year":"2017","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.1287\/opre.21.5.1071","article-title":"The optimal control of partially observable markov precesses over a finite horizon","volume":"21","author":"Smallwood","year":"1973","journal-title":"Oper. Res."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1109\/TWC.2010.02.090055","article-title":"Betting on Gilbert\u2013Elliot channels","volume":"9","author":"Laourine","year":"2010","journal-title":"IEEE Trans. Wirel. Commun."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/10\/510\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:45:33Z","timestamp":1760208333000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/10\/510"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,21]]},"references-count":28,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2017,10]]}},"alternative-id":["e19100510"],"URL":"https:\/\/doi.org\/10.3390\/e19100510","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2017,9,21]]}}}