{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:14:47Z","timestamp":1750220087913,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":18,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,3,18]],"date-time":"2022-03-18T00:00:00Z","timestamp":1647561600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,3,18]]},"DOI":"10.1145\/3532213.3532217","type":"proceedings-article","created":{"date-parts":[[2022,7,13]],"date-time":"2022-07-13T13:29:18Z","timestamp":1657718958000},"page":"18-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Dynamic Resistance Based Spiking Actor Network for Improving Reinforcement Learning"],"prefix":"10.1145","author":[{"given":"Jie","family":"Zhang","sequence":"first","affiliation":[{"name":"College of Computer Science, Sichuan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Runhao","family":"Jiang","sequence":"additional","affiliation":[{"name":"College of Computer Science, Sichuan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rong","family":"Xiao","sequence":"additional","affiliation":[{"name":"College of Computer Science, Sichuan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rui","family":"Yan","sequence":"additional","affiliation":[{"name":"College of Computer Science, Zhejiang University of Technology, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,7,13]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/SYNASC.2005.13"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2007.19.6.1468"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003024"},{"key":"e_1_3_2_1_4_1","unstructured":"S. Fujimoto H\u00a0Van Hoof and D. Meger. 2018. Addressing Function Approximation Error in Actor-Critic Methods. (2018).  S. Fujimoto H\u00a0Van Hoof and D. Meger. 2018. Addressing Function Approximation Error in Actor-Critic Methods. (2018)."},{"key":"e_1_3_2_1_5_1","unstructured":"T. Haarnoja A. Zhou P. Abbeel and S. Levine. 2018. Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor. (2018).  T. Haarnoja A. Zhou P. Abbeel and S. Levine. 2018. Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor. (2018)."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1113\/jphysiol.1952.sp004764"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2202-8-S2-S15"},{"key":"e_1_3_2_1_8_1","volume-title":"Continuous control with deep reinforcement learning. Computer ence","author":"Lillicrap P.","year":"2015","unstructured":"Timothy\u00a0 P. Lillicrap , Jonathan\u00a0 J. Hunt , Alexander Pritzel , Nicolas Heess , Tom Erez , Yuval Tassa , David Silver , and Daan Wierstra . 2015. Continuous control with deep reinforcement learning. Computer ence ( 2015 ). Timothy\u00a0P. Lillicrap, Jonathan\u00a0J. Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. Computer ence (2015)."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2014.03.026"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"F. Nicolas and G. Wulfram. 2016. Neuromodulated Spike-Timing-Dependent Plasticity and Theory of Three-Factor Learning Rules. Frontiers in Neural Circuits 9 172 (2016).  F. Nicolas and G. Wulfram. 2016. Neuromodulated Spike-Timing-Dependent Plasticity and Theory of Three-Factor Learning Rules. Frontiers in Neural Circuits 9 172 (2016).","DOI":"10.3389\/fncir.2015.00085"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2019.08.009"},{"key":"e_1_3_2_1_12_1","unstructured":"Daniel Rasmussen and Chris Eliasmith. 2013. A neural reinforcement learning model for tasks with unknown time delays.  Daniel Rasmussen and Chris Eliasmith. 2013. A neural reinforcement learning model for tasks with unknown time delays."},{"key":"e_1_3_2_1_13_1","unstructured":"J. Schulman F. Wolski P. Dhariwal A. Radford and O. Klimov. 2017. Proximal Policy Optimization Algorithms. (2017).  J. Schulman F. Wolski P. Dhariwal A. Radford and O. Klimov. 2017. Proximal Policy Optimization Algorithms. (2017)."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(03)00761-X"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"G. Tang N. Kumar and K.\u00a0P. Michmizos. 2020. Reinforcement co-Learning of Deep and Spiking Neural Networks for Energy-Efficient Mapless Navigation with Neuromorphic Hardware. (2020).  G. Tang N. Kumar and K.\u00a0P. Michmizos. 2020. Reinforcement co-Learning of Deep and Spiking Neural Networks for Energy-Efficient Mapless Navigation with Neuromorphic Hardware. (2020).","DOI":"10.1109\/IROS45743.2020.9340948"},{"key":"e_1_3_2_1_16_1","volume-title":"Deep Reinforcement Learning with Population-Coded Spiking Neural Network for Continuous Control. In Conference on Robot Learning (CoRL)","author":"Tang G.","year":"2020","unstructured":"G. Tang , N. Kumar , R. Yoo , and K.\u00a0 P. Michmizos . 2020 . Deep Reinforcement Learning with Population-Coded Spiking Neural Network for Continuous Control. In Conference on Robot Learning (CoRL) 2020. G. Tang, N. Kumar, R. Yoo, and K.\u00a0P. Michmizos. 2020. Deep Reinforcement Learning with Population-Coded Spiking Neural Network for Continuous Control. In Conference on Robot Learning (CoRL) 2020."},{"key":"e_1_3_2_1_17_1","volume-title":"Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance. In 2020 International Joint Conference on Neural Networks (IJCNN). 1\u20137. https:\/\/doi.org\/10","author":"Wen Xianglan","year":"2020","unstructured":"Xianglan Wen , Pengjie Gu , Rui Yan , and Huajin Tang . 2020 . Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance. In 2020 International Joint Conference on Neural Networks (IJCNN). 1\u20137. https:\/\/doi.org\/10 .1109\/IJCNN48605.2020.9207236 10.1109\/IJCNN48605.2020.9207236 Xianglan Wen, Pengjie Gu, Rui Yan, and Huajin Tang. 2020. Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance. In 2020 International Joint Conference on Neural Networks (IJCNN). 1\u20137. https:\/\/doi.org\/10.1109\/IJCNN48605.2020.9207236"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2018.00331"}],"event":{"name":"ICCAI '22: 2022 8th International Conference on Computing and Artificial Intelligence","acronym":"ICCAI '22","location":"Tianjin China"},"container-title":["Proceedings of the 8th International Conference on Computing and Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3532213.3532217","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3532213.3532217","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:43Z","timestamp":1750183783000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3532213.3532217"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,18]]},"references-count":18,"alternative-id":["10.1145\/3532213.3532217","10.1145\/3532213"],"URL":"https:\/\/doi.org\/10.1145\/3532213.3532217","relation":{},"subject":[],"published":{"date-parts":[[2022,3,18]]},"assertion":[{"value":"2022-07-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}