节点文献

基于多尺度特征逐层融合深度神经网络的无参考图像质量评价方法

A Deep Neural Network Based on Layer-by-Layer Fusion of Multi-Scale Features for No-Reference Image Quality Assessment

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 杨春玲杨雅静

【Author】 YANG Chunling;YANG Yajing;School of Electronic and Information Engineering, South China University of Technology;

【机构】 华南理工大学电子与信息学院

【摘要】 现有的针对真实失真的无参考图像质量评价算法提取的特征对自然场景图像质量的表征能力较差,限制了其评估准确性和泛化能力。针对该问题,文中提出了一个基于多尺度特征逐层融合的深度神经网络(MsFF-Net)。首先,利用预训练的深度神经网络ResNet-50提取图像多尺度特征;然后,提出了一种特征融合模块,通过逐层递进融合相邻尺度特征,获得更准确表征图像质量的多尺度融合特征;接着,从多尺度融合特征提取低维特征,得到多粒度的图像质量感知特征;最后,利用由最高层特征自适应生成的全连接神经网络,对低维特征进行回归,得到自然场景图像的质量预测。仿真结果表明,MsFF-Net在真实失真数据库上的性能优于目前的大多数方法,而且在合成失真数据库上也取得了出色的评价性能。

【Abstract】 The existing deep network-based no-reference image quality assessment algorithms for authentic distortions have poor performance in representing the quality of natural scene images, which limited their evaluation accuracy and generalization ability. To solve this problem, this paper proposed a deep neural network based on fuse multi-scale features layer-by-layer(MsFF-Net).Firstly, the pre-trained ResNet-50 was used to extract multi-scale features of the image.Then, a multi-scale features fusion module was proposed, which gradually fused adjacent-scale features layer-by-layer to obtain multi-scale fused features that can accurately represent the image quality. The low-dimensional features were further extracted from the multi-scale fused features to obtain multi-granularity image quality perception features. Finally, regression was performed on the low-dimensional features by using a fully connected network which was adaptively generated by the highest-level features. The simulation results show that MsFF-Net outperforms most of the current methods on authentic distortions databases, and it achieves excellent perfor-mances on synthetic distortions databases.

【基金】 广东省自然科学基金资助项目(2017A030311028,2019A1515011949)~~
  • 【文献出处】 华南理工大学学报(自然科学版) ,Journal of South China University of Technology(Natural Science Edition) , 编辑部邮箱 ,2022年04期
  • 【分类号】TP391.41;TP183
  • 【下载频次】193
节点文献中: 

本文链接的文献网络图示:

本文的引文网络