{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T01:04:35Z","timestamp":1780535075753,"version":"3.54.1"},"reference-count":29,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,1,30]],"date-time":"2021-01-30T00:00:00Z","timestamp":1611964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004731","name":"Natural Science Foundation of Zhejiang Province","doi-asserted-by":"publisher","award":["Y20F010069"],"award-info":[{"award-number":["Y20F010069"]}],"id":[{"id":"10.13039\/501100004731","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51874264"],"award-info":[{"award-number":["51874264"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>A traditional successive cancellation (SC) decoding algorithm produces error propagation in the decoding process. In order to improve the SC decoding performance, it is important to solve the error propagation. In this paper, we propose a new algorithm combining reinforcement learning and SC flip (SCF) decoding of polar codes, which is called a Q-learning-assisted SCF (QLSCF) decoding algorithm. The proposed QLSCF decoding algorithm uses reinforcement learning technology to select candidate bits for the SC flipping decoding. We establish a reinforcement learning model for selecting candidate bits, and the agent selects candidate bits to decode the information sequence. In our scheme, the decoding delay caused by the metric ordering can be removed during the decoding process. Simulation results demonstrate that the decoding delay of the proposed algorithm is reduced compared with the SCF decoding algorithm, based on critical set without loss of performance.<\/jats:p>","DOI":"10.3390\/e23020171","type":"journal-article","created":{"date-parts":[[2021,1,30]],"date-time":"2021-01-30T06:22:20Z","timestamp":1611987740000},"page":"171","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Reinforcement Learning for Bit-Flipping Decoding of Polar Codes"],"prefix":"10.3390","volume":"23","author":[{"given":"Xiumin","family":"Wang","sequence":"first","affiliation":[{"name":"Key Laboratory of Electromagnetic Wave Information Technology and Metrology of Zhejiang Province, College of Information Engineering, China Jiliang University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinlong","family":"He","sequence":"additional","affiliation":[{"name":"Key Laboratory of Electromagnetic Wave Information Technology and Metrology of Zhejiang Province, College of Information Engineering, China Jiliang University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun","family":"Li","sequence":"additional","affiliation":[{"name":"Binjiang College, Nanjing University of Information Science and Technology, Wuxi 214105, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liang","family":"Shan","sequence":"additional","affiliation":[{"name":"Key Laboratory of Electromagnetic Wave Information Technology and Metrology of Zhejiang Province, College of Information Engineering, China Jiliang University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3051","DOI":"10.1109\/TIT.2009.2021379","article-title":"Channel polarization: A method for constructing capacity-achieving codes for symmetric binary-input memoryless channels","volume":"55","author":"Arikan","year":"2009","journal-title":"IEEE T. Inform. Theory"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2213","DOI":"10.1109\/TIT.2015.2410251","article-title":"List decoding of polar codes","volume":"61","author":"Tal","year":"2015","journal-title":"IEEE T. Inform. Theory"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1668","DOI":"10.1109\/LCOMM.2012.090312.121501","article-title":"CRC-aided decoding of polar codes","volume":"16","author":"Niu","year":"2012","journal-title":"IEEE Commun. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Afisiadis, O., Balatsoukas-Stimming, A., and Burg, A. (2014, January 2\u20135). A low-complexity improved successive cancellation decoder for polar codes. Proceedings of the Conference Record of the Asilomar Conference on Signals Systems and Computers, Los Alamitos, CA, USA.","DOI":"10.1109\/ACSSC.2014.7094848"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Chandesris, L., Savin, V., and Declercq, D. (2016, January 4\u20138). An improved SCFlip decoder for polar codes. Proceedings of the IEEE Global Communications Conference, New York, NY, USA.","DOI":"10.1109\/GLOCOM.2016.7841594"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2333","DOI":"10.1109\/TCOMM.2018.2793887","article-title":"Dynamic-SCFlip decoding of polar codes","volume":"66","author":"Chandesris","year":"2018","journal-title":"IEEE Trans. Commun."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"57738","DOI":"10.1109\/ACCESS.2018.2873821","article-title":"Progressive bit-flipping decoding of polar codes: A critical-set based tree search approach","volume":"6","author":"Zhang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Condo, C., Ercan, F., and Gross, W.J. (2018, January 15\u201318). Improved successive cancellation flip decoding of polar codes based on error distribution. Proceedings of the 2018 IEEE Wireless Communications and Networking Conference Workshops (WCNCW), Barcelona, Spain.","DOI":"10.1109\/WCNCW.2018.8368991"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, R., Ge, Y., Shi, W., and Zhang, Q. (2018, January 18\u201320). Enhanced bit-flipping successive cancellation decoding for convolutional polar codes. Proceedings of the International Conference on Wireless Communications and Signal Processing, New York, NY, USA.","DOI":"10.1109\/WCSP.2018.8555718"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Condo, C., Bioglio, V., and Land, I. (2019, January 25\u201328). SC-Flip decoding of polar codes with high order error correction based on error dependency. Proceedings of the IEEE Information Theory Workshop (ITW), Visby, Sweden.","DOI":"10.1109\/ITW44776.2019.8989249"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lv, Y., Yin, H., Li, J., Xu, W., and Fang, Y. (2019, January 9\u201310). Modified successive cancellation flip decoder for polar codes based on gaussian approximation. Proceedings of the International Conference on Wireless and Optical Communications Networks, New York, NY, USA.","DOI":"10.1109\/WOCC.2019.8770559"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/TCOMM.2018.2873322","article-title":"Improved bit-flipping algorithm for successive cancellation decoding of polar codes","volume":"67","author":"Ercan","year":"2019","journal-title":"IEEE Trans. Commun."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3042","DOI":"10.1109\/ACCESS.2019.2962003","article-title":"BER evaluation based SCFlip algorithm for polar codes decoding","volume":"8","author":"Zhang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Cao, A., Zhang, L., Qiao, J., and He, Y. (2019, January 11\u201313). An LLR-based segmented flipped SCL decoding algorithm for polar codes. Proceedings of the IEEE\/CIC International Conference on Communications in China (ICCC), Changchun, China.","DOI":"10.1109\/ICCChina.2019.8855853"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"83424","DOI":"10.1109\/ACCESS.2019.2922664","article-title":"Generalized segmented bit-flipping scheme for successive cancellation decoding of polar codes with cyclic redundancy check","volume":"7","author":"Li","year":"2019","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Fang, Y., Li, J., and Lv, Y. (2019, January 18\u201321). Improved segmented SC-Flip decoding of polar codes based on gaussian approximation. Proceedings of the 4th International Conference on Smart and Sustainable Technologies (SpliTech), Split, Croatia.","DOI":"10.23919\/SpliTech.2019.8783128"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"27851","DOI":"10.1109\/ACCESS.2020.2964904","article-title":"Improved multiple bit-flipping fast-SSC decoding of polar codes","volume":"8","author":"Wang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ebada, M., Cammerer, S., Elkelesh, A., and ten Brink, S. (2019, January 24\u201327). Deep learning-based polar code design. Proceedings of the 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton), Monticello, IL, USA.","DOI":"10.1109\/ALLERTON.2019.8919804"},{"key":"ref_19","unstructured":"(2018, April 09). Technical Specification Group Radio Access Network. 3GPP, 2018, TS 38.212 V.15.1.1. Available online: https:\/\/www.3gpp.org\/ftp\/Specs\/archive\/38_series\/38.212\/."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Gruber, T., Cammerer, S., Hoydis, J., and ten Brink, S. (2017, January 22\u201324). On deep learning-based channel decoding. Proceedings of the 2017 51st Annual Conference on Information Sciences and Systems (CISS), Baltimore, MD, USA.","DOI":"10.1109\/CISS.2017.7926071"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Doan, N., Hashemi, S.A., and Gross, W.J. (2018, January 25\u201328). Neural successive cancellation decoding of polar codes. Proceedings of the 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), Kalamata, Greece.","DOI":"10.1109\/SPAWC.2018.8445986"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gao, J., Dai, J., and Niu, K. (2019, January 8\u201311). Learning to decode polar codes with quantized LLRs passing. Proceedings of the 2019 IEEE 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Istanbul, Turkey.","DOI":"10.1109\/PIMRC.2019.8904378"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhang, M., Huang, Q., Wang, S., and Wang, Z. (2018, January 18\u201320). Construction of LDPC codes based on deep reinforcement learning. Proceedings of the 2018 10th International Conference on Wireless Communications and Signal Processing (WCSP), Hangzhou, China.","DOI":"10.1109\/WCSP.2018.8555714"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/TCOMM.2019.2951403","article-title":"AI coding: Learning to construct error correction codes","volume":"68","author":"Huang","year":"2020","journal-title":"IEEE Trans. Commun."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Carpi, F., H\u00e4ger, C., Martal\u00f2, M., Raheli, R., and Pfister, H.D. (2019, January 24\u201327). Reinforcement learning for channel coding: Learned bit-flipping decoding. Proceedings of the 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton), Monticello, IL, USA.","DOI":"10.1109\/ALLERTON.2019.8919799"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wang, X., Zhang, H., Li, R., Huang, L., Dai, S., Huangfu, Y., and Wang, J. (2019, January 8\u201311). Learning to flip successive cancellation decoding of polar codes with LSTM networks. Proceedings of the IEEE 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Istanbul, Turkey.","DOI":"10.1109\/PIMRC.2019.8904878"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1613\/jair.301","article-title":"Reinforcement learning: A survey","volume":"4","author":"Kaelbling","year":"1996","journal-title":"J. Artif. Intell. Res."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1109\/TSP.2012.2223693","article-title":"A semi-parallel successive-cancellation decoder for polar codes","volume":"61","author":"Leroux","year":"2012","journal-title":"IEEE Trans. Signal Process."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/2\/171\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:17:26Z","timestamp":1760159846000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/2\/171"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,30]]},"references-count":29,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["e23020171"],"URL":"https:\/\/doi.org\/10.3390\/e23020171","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,30]]}}}