节点文献
以分离噪声特征为引导的真实图像降噪
Real image denoising via separating features
【摘要】 目的 基于合成噪声训练的去噪模型在实际应用中效果不佳。同时,许多真实图像去噪算法仅对图像进行端到端处理,未充分利用噪声信号的整体信息,不能有效去除噪声对图像结构信息的干扰。针对这些问题,提出一种以分离噪声特征为引导的真实图像降噪网络。方法 采用特征分离的策略,设计噪声图像到无噪声图像映射和无噪声图像到噪声图像映射的对称网络约束噪声特征分离,从而将噪声特征从图像内容特征中分离开来。采用对比学习对噪声特征提取进行进一步的约束,提高模型对噪声特征的学习能力。然后将分离模块提取到的噪声特征作为图像降噪的先验,噪声特征引导网络在特征域进行噪声特征的抑制。最后,双向映射都通过相应的损失函数进行约束,该网络架构具有较强的适应性和稳定性。结果 实验在SIDD(smartphone image denoising dataset),DND(darmstadt noise dataset)sRGB和PolyU(PolyU-real-world-noisy-images-dataset) 3个数据集上进行测试。在PolyU数据集上与其他算法相比,峰值信噪比(peak signal-to-noise ratio,PSNR)提高0.25%,结构相似性(structural similarity index measure,SSIM)提高0.72%;在SIDD数据集中进行消融实验以验证分离网络的有效性。结论 本文提出的特征分离—引导降噪模型,综合特征分离和特征引导的思想,并融合对比学习的优点。该模型更好地利用了噪声信息,针对性地进行图像降噪,提升了图像降噪的稳定性和泛化性。
【Abstract】 Objective Image noise refers to the distortion phenomenon in visual signals caused by random variations or external interference.This phenomenon often leads to poor performance in various computational tasks.The core goal of image denoising is to restore clear,accurate,and high-quality images from those affected by noise interference,which makes them more consistent with human visual perception for subsequent image analysis,processing,or visual presentation.Currently,restoring damaged high-quality images has become a primary objective in the field of image processing.Many studies have achieved promising results in dealing with known distributions of noise (such as additive Gaussian white noise).However,real-world noise differs fundamentally from synthetic noise due to its origins from various factors,such as changes in lighting conditions,sensor stability,and environmental interference.This complexity leads to poor generalization capability of models trained on synthetic noise when faced with real noise,which results in suboptimal denoising effects.Some deep learning methods directly learn residual images through networks and use differences as constraints to realize image denoising.However,real noise exhibits high non-uniformity and complexity,while single-task networks for pixel-space noise separation often ignores the complexity of noise distribution and the correlation between noise and the overall structure of the image.Therefore,this approach easily mistakes non-noise information in the image for noise and removes it.This error leads to loss of image clarity and details,which disrupts the overall structure of the image.Meanwhile,some methods adopt a combination of traditional methods and deep learning,which utilizes prior information to separate image data.Compared with traditional direct mapping approaches,these methods are more flexible and can more accurately locate and process noise.Thus,they improve the adaptability to different types of noise to some extent.However,these techniques have certain limitations in that they tend to ignore the characteristics of the image itself,which may affect its overall structure during denoising.In addition,such means usually require additional computational and network steps,which may be limited in practical applications.We propose a noise feature separation network to mitigate the impact of noise learning bias on the image itself and better balance prior information and image characteristics.Method In this study,we draw inspiration from the concept of separation and employ a multi-module joint network,which is called the feature separation and guidance for real image denoising network,to realize feature separation and guidance.This network comprises a separation module,a guidance module,and a contrastive learning module.Considering that convolutional neural networks (CNNs) may overlook the global structural information of images when extracting deep semantic features,the basic architecture network of our network module is implemented using a cross-structure of CNN and Transformer.First,we designed a symmetric network to constrain the noise separation module without relying on any prior information.The symmetric network learns the bidirectional mapping relationship of images by mapping noise images to noise-free images,and vice versa.Subsequently,the separated noise features are used as guidance information for the image denoising module,which enables multi-scale guidance for removing noise signal features in the feature space.Finally,based on the idea of contrastive learning,we further constrain the separation module by leveraging the differences between positive and negative samples to realize noise feature separation.Given that our model learns the bidirectional mapping relationship between noisy and noise-free images,the noise separation module is constrained by structural and contrastive losses.This constraint provides more accurate noise signal features for the image denoising module and enhances the accuracy and generalization performance of the network denoising.Result Experiments were conducted on the SIDD dataset for training and on three datasets (smartphone image denoising dataset(SIDD),darmstadt noise dataset(DND) s RGB,and Poly U-real-world-noisyimages-dataset(Poly U)) for testing.Compared with other real image denoising methods,our approach produces more consistent results in peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM).Specifically,on the Poly U dataset,PSNR improved by 0.25%,and SSIM enhanced by 0.72%.Several ablation experiments were also conducted,and the effectiveness of each algorithm module was verified through visual demonstrations.Experimental results demonstrate that our proposed algorithm significantly improves the effect of image denoising and enhances the generalization performance of the model to a certain extent.Conclusion This study proposes a feature space separation-guided denoising model.Based on the concept of feature separation,this model effectively transforms between feature space and pixel space,which enables flexible learning of noise signal features and provides accurate guidance information for the denoising model.Further adoption of contrastive learning improves the learning of noise signal features.Leveraging the crossstructure of Transformer and CNN enhances the retention of image features during the denoising process,which reduces the loss of key information.This network architecture efficiently separates the noise features within the image from its intrinsic features.As a result,more accurate localization and processing of noise signals is realized while preserving the original details and structure of the image.By separating and reconstructing noise signals in the feature space,our method minimizes the loss of overall image information during the denoising process,which improves denoising effectiveness and maintains image quality.The proposed method exhibits competitive performance when compared with representative state-of-theart methods for image denoising.
【Key words】 image denoising; real noise; feature separation; feature guidance; contrastive learning;
- 【文献出处】 中国图象图形学报 ,Journal of Image and Graphics , 编辑部邮箱 ,2025年10期
- 【分类号】TP391.41
- 【下载频次】54