节点文献

一种基于帧图像的动态视觉传感器样本集建模方法

A Dynamic Vision Sensor Sample Set Modeling Method Based on Frame Images

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 陆兴鹏王明羽曹扬赵瑞莲周武李兆麟魏少军

【Author】 LU Xing-peng;WANG Ming-yu;CAO Yang;ZHAO Rui-lian;ZHOU Wu;LI Zhao-lin;WEI Shao-jun;Department of Computer Science and Technology,Tsinghua University;School of Information Science and Technology,Beijing University of Chemical Technology;Institute of Microelectronics,Tsinghua University;Beijing Aerospace Chenxin Science and Technology Ltd.;

【通讯作者】 王明羽;

【机构】 清华大学计算机科学与技术系北京化工大学信息科学与技术学院清华大学微电子学研究所北京航天晨信科技有限公司

【摘要】 动态视觉传感器(Dynamic Vision Sensor,DVS)利用事件驱动原理实现运动目标的快速提取,具有低延迟、低存储空间和高动态范围等优势.目前研究表明,基于DVS的神经网络在目标检测等领域具有明显的速度优势.但是,这类神经网络在训练时所需要的样本集主要依赖DVS相机产生,缺少高效的样本集生成方法,这制约了这类神经网络的应用与发展.本文根据DVS原理,提出了一种基于帧图像的DVS建模以及样本集建模方法.该方法设定每个像素单元独立工作,经过动态差分和逻辑判断后输出触发的地址-事件数据,这些数据通过编码和归一化生成神经网络训练时所需要的样本集.通过对MNIST和CIFAR-10样本集建模的实验结果表明,该建模方法效果与DVS相机基本一致;与基于帧图像的存储方式相比,该样本集可以明显减少存储空间.该方法所生成样本集已经通过卷积神经网络训练和测试验证.

【Abstract】 Dynamic vision sensor(DVS)shows significant advantages on low computational latency,low memory usage and high dynamic range by utilizing the event-driven principle to extract features from moving objects.Current research shows that DVS-based neural networks improve object detection speed obviously.However,the sample sets required by such neural networks mainly rely on specific DVS cameras while lacking efficient generation methods for the sample sets.It limits the application and development of those neural networks.According to the principle of DVS,this paper presents a DVS sample set modeling method based on frame images,in which the sample set can be generated by encoding and normalizing the address-event(AE)data after being trigged by dynamic differential comparisons and logical judgments.The experimental results for modeling the MNIST and CIFAR-10 sample sets show that,the sample set modeled by the proposed method is basically matched with the real DVS cameras.Compared with traditional frame image sample sets,this method can significantly reduce the memory usage.The sample set generated by the proposed modeling method has also been verified by training and testing a typical convolutional neural network.

【基金】 中国博士后科学基金(No.2019M650030);清华大学自主科研计划(No.2018Z05JDX005)
  • 【文献出处】 电子学报 ,Acta Electronica Sinica , 编辑部邮箱 ,2020年08期
  • 【分类号】TP391.41;TP212
  • 【被引频次】3
  • 【下载频次】263
节点文献中: 

本文链接的文献网络图示:

本文的引文网络