节点文献

FDLIE-YOLO:频域增强的端到端低照度图像目标检测方法

FDLIE-YOLO: Frequency domain enhanced end-to-end low-light image target detection method

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 李扬; 李现国; 陈莲; 杨清永; 徐常余; 徐晟;

【Author】 LI Yang;LI Xianguo;CHEN Lian;YANG Qingyong;XU Changyu;XU Sheng;School of Electronics and Information Engineering,Tiangong University;School of Software and Communications,Tianjin Sino-German University of Applied Sciences;Tianjin Key Laboratory of Optoelectronic Detection Technology and Systems;School of Aeronautics and Astronautics,Tianjin Sino-German University of Applied Sciences;

【通讯作者】 陈莲;

【机构】 天津工业大学电子与信息工程学院; 天津中德应用技术大学软件与通信学院; 天津市光电检测技术与系统重点实验室; 天津中德应用技术大学航空航天学院;

【摘要】 针对低照度图像目标检测的挑战,提出一种端到端检测方法 FDLIE-YOLO。首先,设计频域处理模块FDPB(Frequency Domain Processing Block),采用傅里叶变换提取全局信息,从而获取估计幅度分量,利用其与亮度的正相关关系,提升低光照图像质量,进而构建频域低照度图像增强网络FDLIENet(Frequency Domain Low-light Image Enhancement Network)。然后,使用YOLOv8n进行目标检测,通过联合损失实现图像增强与目标检测的端到端训练。该损失引入马氏距离的幅度差异损失,以精准调整图像幅度,并用MPDIoU(Minimum Point Distance based IoU)损失取代YOLOv8n原有的回归损失,提高检测准确性。实验结果显示,FDLIENet在低照度环境下的图像增强表现显著,在LOLReal和ExDark数据集上的PSNR、SSIM和NIQE指标分别达到23.18 dB、0.858和3.98;FDLIEYOLO在ExDark数据集,平均精度均值mAP为80.6%,较当前主流端到端检测方法提高了1.1%~1.6%,且实时性好。

【Abstract】 Objective Many object target methods perform excellently under ideal lighting conditions,but their performance is not satisfactory in environments with varying lighting,particularly in low-light conditions Applications such as autonomous vehicles at night,surveillance drones,and security systems requiring continuous monitoring often face challenges under low illumination conditions.Consequently,there is a heightened demand for the performance of target detection methods in low-light environments.Low-light conditions lead to a degradation in image quality,including reduced brightness,decreased contrast,increased noise,loss of detail,and color deviation.These issues significantly impair the accuracy of target detection methods.These issues not only alter the visual appearance of the images but also negatively impact the performance of object detection methods Therefore,it is crucial to design an end-to-end object detection method that integrates an image enhancement network with a target detector,specifically for low-illumination environments,to maintain high detection accuracy.For this purpose,an end-to-end target detection method for low-illumination images is designed in this paper,named FDLIE-YOLO,which effectively enhances detection accuracy and confidence,reducing omissions and misjudgments.Methods To enhance target detection performance in low-light conditions and reduce missed detections and false positives,an end-to-end low-light image object detection method called FDLIE-YOLO (Fig.1) has been proposed.Firstly,the FDLIENet (Frequency Domain Low-Illumination Image Enhancement Network) is constructed,with the core component being the frequency domain processing module FDPB (Frequency Domain Processing Block)(Fig.2).This Block extracts global information from the image through Fourier transform and based on the positive correlation between amplitude and brightness,enlarges the amplitude components to enhance both the image brightness and contrast,effectively improving the image quality under low-illumination conditions.Adopting YOLOv8n as the detection module,and achieving end-to-end training through a joint loss function,optimizes image enhancement and target detection(Fig.3).The combined loss comprises a magnitude difference loss with Mahalanobis distance to precisely control image magnitude,and employs the MPDIoU(Minimum Point Distance based IoU) loss to replace the original regression loss,thereby enhancing detection accuracy.Results and Discussions The experiments were conducted on two datasets:the LOL-Real dataset and the ExDark dataset,FDLIENet with the mainstream low-light image enhancement network on the LOL-Real dataset and the ExDark dataset enhancement effect (Fig.5-Fig.6),the de-enhanced image obtained by the network has lower distortion and chromatic aberration than the other algorithms,and it can retain more important image information in the image.As can be seen from the results of illumination image enhancement experiments (Tab.1-Tab.2),except for SNR-Aware,PSNR is improved by at least 1.7 dB and SSIM is increased by at least 0.011;compared to FECNet and PENet,PSNR is improved by 2.51 dB and 1.7 dB,and SSIM is improved by 0.063 and0.020,respectively;The average NIQE index on the ExDark data NIQE average index on the ExDark data set,significantly exceeds MBLLEN,ZeroDCE,KinD,and reduces 0.35 and 0.30 compared to FECNet and PENet,respectively;Param is only 0.14 which has a significant advantage over other enhancement networks;The above results show that the image has better enhancement performance.As can be seen in the detection results of the FDLIE-YOLO end-to-end low illumination image target detection method (Fig.7),the detection results of this paper’s method can reduce the leakage and misdetection and show better confidence.As can be seen from the illumination image target detection experimental results (Tab.3-Tab.4),the low illumination image target detection results obtained by applying this paper’s method,the target detection accuracy of FDLIE-YOLO in low illumination exceeds that of IA-YOLO and PE-YOLO,and the mAP improves by 1.6 percentage points and 1.1percentage points,respectively;And the Param is only 3.16M,and the FPS is 88.82,which proves the excellent detection performance of this paper’s method in low illumination environment.Conclusions An FDLIE-YOLO low-light image target detection method is designed.The method features simple structure,good image enhancement,high degree of target detection accuracy,and achieves more advanced SOTA results with better detection performance.The experimental results show that FDLIENet has a peak signalto-noise ratio (PSNR) and structural similarity (SSIM) mean value of 23.18 and 0.858 on the LOL-Real dataset,and a natural image quality evaluator (NIQE) mean value of 3.98 on the ExDark dataset,which is superior to the state-of-the-art low-illumination image enhancement networks in recent years.FDLIE-YOLO achieves a mean accuracy (mAP) of 80.6%on the ExDark dataset,which is ahead of YOLOv8 and other end-to-end target detection methods,and the number of parameters (Param) is only 3.16 M,and the number of detected frames per second (FPS) is 88.82,which proves the excellent detection performance of this paper’s method in low illumination environment.

【基金】 国家自然科学基金项目(52271341);天津市科技计划项目(24YDTPJC00410);天津市技术创新引导专项(基金)项目(23YDTPJC00290);江苏省重点实验室对外开放课题资助项目(zdsys2019-11)~~
  • 【文献出处】 红外与激光工程 ,Infrared and Laser Engineering , 编辑部邮箱 ,2025年01期
  • 【分类号】TP183;TP391.41
  • 【下载频次】204
节点文献中: 

本文链接的文献网络图示:

本文的引文网络