{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T12:22:33Z","timestamp":1764937353950,"version":"3.40.5"},"reference-count":45,"publisher":"SAGE Publications","issue":"12","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the basic research projects in the University of Henan Province","award":["19zx010"],"award-info":[{"award-number":["19zx010"]}]},{"name":"the Key Scientific and Technological Projects Henan Province","award":["No. 202102210169"],"award-info":[{"award-number":["No. 202102210169"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No. 61871430"],"award-info":[{"award-number":["No. 61871430"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Scientific and Technological Innovation Team of Colleges and Universities in Henan Province","award":["20IRTSTHN018"],"award-info":[{"award-number":["20IRTSTHN018"]}]},{"DOI":"10.13039\/501100013066","name":"key scientific research project of colleges and universities in henan province","doi-asserted-by":"publisher","award":["22A520005"],"award-info":[{"award-number":["22A520005"]}],"id":[{"id":"10.13039\/501100013066","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["International Journal of Distributed Sensor Networks"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:p> Policy gradient methods are effective means to solve the problems of mobile multimedia data transmission in Content Centric Networks. Current policy gradient algorithms impose high computational cost in processing high-dimensional data. Meanwhile, the issue of privacy disclosure has not been taken into account. However, privacy protection is important in data training. Therefore, we propose a randomized block policy gradient algorithm with differential privacy. In order to reduce computational complexity when processing high-dimensional data, we randomly select a block coordinate to update the gradients at each round. To solve the privacy protection problem, we add a differential privacy protection mechanism to the algorithm, and we prove that it preserves the [Formula: see text]-privacy level. We conduct extensive simulations in four environments, which are CartPole, Walker, HalfCheetah, and Hopper. Compared with the methods such as important-sampling momentum-based policy gradient, Hessian-Aided momentum-based policy gradient, REINFORCE, the experimental results of our algorithm show a faster convergence rate than others in the same environment. <\/jats:p>","DOI":"10.1177\/15501477211059934","type":"journal-article","created":{"date-parts":[[2021,12,14]],"date-time":"2021-12-14T13:02:36Z","timestamp":1639486956000},"page":"155014772110599","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["A randomized block policy gradient algorithm with differential privacy in Content Centric Networks"],"prefix":"10.1177","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1704-5144","authenticated-orcid":false,"given":"Lin","family":"Wang","sequence":"first","affiliation":[{"name":"School of Information Engineering, Henan University of Science and Technology, Luoyang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1844-7639","authenticated-orcid":false,"given":"Xingang","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Henan University of Science and Technology, Luoyang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4361-8604","authenticated-orcid":false,"given":"Xuhui","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Henan University of Science and Technology, Luoyang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4631-0317","authenticated-orcid":false,"given":"Baozhu","family":"Li","sequence":"additional","affiliation":[{"name":"Internet of Things & Smart City Innovation Platform, Zhuhai Fudan Innovation Institute, Zhuhai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0932-8788","authenticated-orcid":false,"given":"Ruijuan","family":"Zheng","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Henan University of Science and Technology, Luoyang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1572-5293","authenticated-orcid":false,"given":"Qingtao","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Henan University of Science and Technology, Luoyang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2021,12,14]]},"reference":[{"key":"bibr1-15501477211059934","unstructured":"Alt B, \u0160o\u0161i\u0107 A, Koeppl H. Correlation priors for reinforcement learning, https:\/\/arxiv.org\/abs\/1909.05106 (2019, accessed 12 October 2020)."},{"key":"bibr2-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2019.2950109"},{"key":"bibr3-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2019.2897001"},{"key":"bibr4-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2019.2904358"},{"key":"bibr5-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1109\/TNSM.2018.2863563"},{"key":"bibr6-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2018.2885530"},{"key":"bibr7-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2017.2709462"},{"key":"bibr8-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"bibr9-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1038\/nature24270"},{"key":"bibr10-15501477211059934","doi-asserted-by":"crossref","unstructured":"Zheng G, Zhang F, Zheng Z, et al. DRN: a deep reinforcement learning framework for news recommendation. In: Proceedings of the 2018 World Wide Web conference on World Wide Web (WWW\u201918), Lyon, 23\u201327 April 2018, pp.167\u2013176. New York: ACM.","DOI":"10.1145\/3178876.3185994"},{"key":"bibr11-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2017.1601162"},{"key":"bibr12-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2020.102587"},{"key":"bibr13-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992696"},{"key":"bibr14-15501477211059934","first-page":"1057","volume-title":"Advances in neural information processing systems 12","author":"Sutton RS","year":"2000"},{"key":"bibr15-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1613\/jair.806"},{"key":"bibr16-15501477211059934","unstructured":"Xu T, Liu Q, Peng J. Stochastic variance reduction for policy gradient estimation, https:\/\/arxiv.org\/pdf\/1710.06034.pdf (2018, accessed 12 September 2020)."},{"key":"bibr17-15501477211059934","unstructured":"Papini M, Binaghi D, Canonaco G, et al. Stochastic variance-reduced policy gradient, https:\/\/ui.adsabs.harvard.edu\/abs\/2018arXiv180605618P (2018, accessed 6 January 2020)."},{"key":"bibr18-15501477211059934","first-page":"4422","volume-title":"Proceedings of the 37th international conference on machine learning (virtual event)","volume":"119","author":"Huang F"},{"first-page":"9630","volume-title":"Proceedings of the 33rd conference on neural information processing systems","author":"Gitman I","key":"bibr19-15501477211059934"},{"key":"bibr20-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2953288"},{"key":"bibr21-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.2984011"},{"first-page":"5729","volume-title":"Proceedings of the 36th international conference on machine learning","author":"Shen Z","key":"bibr22-15501477211059934"},{"first-page":"2672","volume-title":"Proceedings of the 25th international conference on neural information processing systems","author":"Le Roux N","key":"bibr23-15501477211059934"},{"first-page":"1646","volume-title":"Proceedings of the 27th international conference on neural information processing systems","author":"Defazio A","key":"bibr24-15501477211059934"},{"first-page":"89","volume-title":"Proceedings of the 34th international conference on machine learning","author":"Allen-Zhu Z","key":"bibr25-15501477211059934"},{"first-page":"687","volume-title":"Proceedings of the 32nd international conference on neural information processing systems","author":"Fang C","key":"bibr26-15501477211059934"},{"first-page":"2613","volume-title":"Proceedings of the 34th international conference on machine learning","author":"Nguyen LM","key":"bibr27-15501477211059934"},{"volume-title":"Proceedings of the 8th international conference on learning representations","author":"Xu P","key":"bibr28-15501477211059934"},{"first-page":"1073","volume-title":"Proceedings of the 32nd international conference on neural information processing systems","author":"Xie T","key":"bibr29-15501477211059934"},{"first-page":"1232","volume-title":"Proceedings of the 35th international conference on machine learning","author":"Diakonikolas J","key":"bibr30-15501477211059934"},{"volume-title":"Proceedings of the 28th international conference on neural information processing systems","author":"Zhao T","key":"bibr31-15501477211059934"},{"key":"bibr32-15501477211059934","first-page":"53","volume-title":"Proceedings of the 30th international conference on machine learning","volume":"28","author":"Lacoste-Julien S"},{"first-page":"185","volume-title":"Proceedings of the 53rd IEEE conference on decision and control","author":"Singh C","key":"bibr33-15501477211059934"},{"first-page":"6380","volume-title":"Proceedings of the 2019 IEEE 58th conference on decision and control","author":"Lin Y","key":"bibr34-15501477211059934"},{"key":"bibr35-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2018.06.002"},{"key":"bibr36-15501477211059934","doi-asserted-by":"publisher","DOI":"10.1109\/TSIPN.2018.2797806"},{"key":"bibr37-15501477211059934","first-page":"746","volume-title":"Proceedings of the 2019 IEEE 43rd annual computer software and applications conference","volume":"1","author":"Gao R"},{"key":"bibr38-15501477211059934","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1007\/978-3-030-37228-6_13","volume-title":"Proceedings of the security and privacy in communication networks\u201415th EAI international conference (SecureComm)","volume":"304","author":"Ding J"},{"key":"bibr39-15501477211059934","first-page":"130","volume-title":"Proceedings of the 12th international conference on cloud computing (CLOUD\u20192019; held as part of the Services Conference Federation)","volume":"11513","author":"Cheng H"},{"first-page":"3057","volume-title":"Proceedings of the 2019 IEEE international conference on acoustics, speech and signal processing (ICASSP)","author":"Dai C","key":"bibr40-15501477211059934"},{"first-page":"8026","volume-title":"Proceedings of the 33rd conference on neural information processing systems","author":"Paszke A","key":"bibr41-15501477211059934"},{"first-page":"5026","volume-title":"Proceedings of the 2012 IEEE\/RSJ international conference on intelligent robots and systems","author":"Todorov E","key":"bibr42-15501477211059934"},{"first-page":"1329","volume-title":"Proceedings of the 33rd international conference on machine learning","author":"Duan Y","key":"bibr43-15501477211059934"},{"key":"bibr44-15501477211059934","unstructured":"Abadi M, Agarwal A, Barham P, et al. TensorFlow: large-scale machine learning on heterogeneous distributed systems, https:\/\/arxiv.org\/abs\/1603.04467 (2015, accessed 5 February 2020)."},{"key":"bibr45-15501477211059934","unstructured":"OpenAI Gym, https:\/\/gym.openai.com\/ (2018, accessed 10 February 2020)."}],"container-title":["International Journal of Distributed Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15501477211059934","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/15501477211059934","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15501477211059934","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,14]],"date-time":"2021-12-14T13:03:13Z","timestamp":1639486993000},"score":1,"resource":{"primary":{"URL":"http:\/\/journals.sagepub.com\/doi\/10.1177\/15501477211059934"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":45,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["10.1177\/15501477211059934"],"URL":"https:\/\/doi.org\/10.1177\/15501477211059934","relation":{},"ISSN":["1550-1477","1550-1477"],"issn-type":[{"type":"print","value":"1550-1477"},{"type":"electronic","value":"1550-1477"}],"subject":[],"published":{"date-parts":[[2021,12]]}}}