节点文献
基于知识蒸馏的脉冲神经网络强化学习方法
Reinforcement Learning of Spiking Neural Network Based on Knowledge Distillation
【摘要】 提出一种基于知识蒸馏的脉冲神经网络(SNN)强化学习方法 SDN。该方法利用STBP梯度下降法,实现深度神经网络(DNN)向SNN强化学习任务的知识蒸馏。实验结果表明,与传统的SNN强化学习和DNN强化学习方法相比,该方法可以更快地收敛,能获得比DNN参数量更小的SNN强化学习模型。将SDN部署到神经形态学芯片上,证明其功耗比DNN低,是高性能的SNN强化学习方法,可以加速SNN强化学习的收敛。
【Abstract】 We propose the reinforcement learning method of Spike Distillation Network(SDN), which uses STBP gradient descent method to realize the knowledge distillation from Deep Neural Network(DNN) to Spiking Neural Network(SNN) reinforcement learning tasks. Experiment results show that SDN converges faster than traditional SNN reinforcement learning and DNN reinforcement learning methods, and can obtain a SNN reinforcement learning model with smaller parameters than DNN. SDN is deployed to the neuromorphology chip, and the power consumption is lower than DNN, proving that SDN is a new and high-performance SNN reinforcement learning method and can accelerate the convergence of SNN reinforcement learning.
【Key words】 spiking neural network(SNN); reinforcement learning; knowledge distillation;
- 【文献出处】 北京大学学报(自然科学版) ,Acta Scientiarum Naturalium Universitatis Pekinensis , 编辑部邮箱 ,2023年05期
- 【分类号】TP18
- 【下载频次】45