节点文献

一种基于K-D树结构和时空近似最优匹配的视频修复方法

A Video Inpainting Method Based on K-Dimension Tree Structure and Approximate Nearest Matching in Time-spatial Space

【作者】 李俊杰

【导师】 王欣;

【作者基本信息】 吉林大学 , 计算机应用技术, 2011, 硕士

【摘要】 近几年来,随着个人计算机的普及以及互联网行业的迅猛发展,人们在数字图像、视频等方面的应用及需求与日俱增,从而使得计算机图形学在短短十年间得到了空前的发展。图像及视频修复技术作为计算机图形学研究领域中的一个重要的分支,也已经成为广大学者研究的热点问题。本文的研究起点源于数字图像修复技术。对图像中的破损部分(如污点、划痕等)进行修复,并在此基础上,详细阐述了图像修复技术在视频修复中的应用与拓展。本文首先对几类典型的图像修复算法和视频修复算法进行了分析、概括以及比较,并以此为基础,提出了一种新的基于K-D树结构及时空近似最优匹配的视频修复方法。该算法结合了传统的基于纹理的修复方法及基于偏微分方程的修复方法的优点,能够较好地修复视频帧中缺损部分的结构信息及纹理信息。此外,该算法还充分考虑到了视频中相邻帧间的时间域上的相关性,使修复后视频的相邻帧之间保持了较好的连贯性。为了保证算法的执行效率,本文还使用了K-D树作为搜索集的基本结构,大大降低了多维搜索及匹配操作的时间复杂度。

【Abstract】 In recent years, with the rapid development of personal digital camera products and Internet industry, the researching in computer graphics and image processing get more and more researchers’attention and image and video inpainting technology has gradually become a hot topic in this field. Image inpainting is the technology that restores the defect area using the valid information around it. Image inpainting technology is mainly used to restore the broken part (such as stains and scratches) in photos and paintings and to remove the specified object in images. Video inpainting is the technology based on the traditional image inpainting technology to restore several frames in a video.The starting point of this paper is the traditional digital image inpainting technology; the paper analyzed some kinds of typical inpainting method and compared them. So far, image inpainting methods can be divided into two categories, one is based on partial differential equations (PDE) and the other is based on the texture. The two types of inpainting methods are described in great detail in the second chapter of this paper and are explained with specific examples in the third chapter.The inpainting method based on partial differential equations can better fix the color and structural features of the defect area. The method doesn’t relate to complex processes, avoiding the detection and segmentation of the object in the target image. But use the method to inpaint large hole area, if the distance between the pixel which is fixing and the boundary of the hole area is too far, the result of the inpainting will be unclear. Therefore, the result that inpaint images using the method based on partial differential equations is well in terms of structural information but is lack in terms of texture information. So, this method is suitable for inpainting small defect area (such as scratches in the image, etc.).The main idea of the inpainting method based on texture can inpaint well in terms of texture information, so it is suitable for inpainting large hole area but not for inpainting small hole area than the method based on partial differential equations.In this paper, these two methods has been developed to be applied on video inpainting, According to the analysis above, a new video inpainting method-A Video Inpainting Method Based on K-Dimension Tree Structure and Approximate Nearest Matching in Time-Spatial Space-is proposed in the fourth chapter. It is a iterative algorithm and each iteration of the algorithm only to repair one pixel, so the algorithm can avoid the lack of the result that inpaint using the method based on texture in terms of continuity. In addition, since the algorithm is to fix images from the external of the hole area to the internal, so the structural information can be fixed well.Another innovation of this paper is that the K-Dimension tree data structure is used in the video inpainting algorithm for the first time, the advantage of this structure is that searching and matching operations for multidimensional vector can be finished in lower time complexity by using K-Dimension tree structure. Using this structure can greatly reduce the calculation of the inpainting process caused by the searching and matching and improving the efficiency of the algorithm.The second half in the fourth chapter shows the experimental results for several groups of different experimental data. Each group of experimental data represents a typical kind of video inpainting problems. According to the analysis and comparison to the experimental results, it could be seen that the video inpainting method that proposed in this paper is better than traditional video inpainting methods. In the last part of the fourth chapter, this view is proven to be correct by using objective evaluation criteria.Chapter V summarizes the full text and points out the deficiency and made several recommendations for improvements. Due to the limitations of current level of the development of computer hardware, this algorithm has not yet reached the desired results, but it is believed that with the development of the computer science and technology, the algorithm that is proposed in this paper can have large improvement in terms of efficiency and inpainting effect.

  • 【网络出版投稿人】 吉林大学
  • 【网络出版年期】2011年 09期
节点文献中: 

本文链接的文献网络图示:

本文的引文网络