节点文献

多视点自由立体视频采集系统校正方案研究

Image Rectification Schemes of Multi-view Auto-stereoscopic Video Capture System

【作者】 李伟

【导师】 肖谧;

【作者基本信息】 天津大学 , 微电子学与固体电子学, 2013, 硕士

【摘要】 自由立体电视作为多视点成像最重要的应用,为用户提供了从多角度观看场景的能力,增强了传统媒体提供给用户的体验,因此受到越来越多泛的关注。本文首先介绍了自由视点电视技术及国内外的主要发展状况,分析了多视点自由立体视频采集系统目前在采集、显示与感知方面存在的问题,由此提出了一种能使多视点立体图像失真最小的校正方法。利用本文提出的校正算法,能较好地校正立体图像对之间存在的旋转、垂直和水平方向的误差,获得理想的图像。最后,在经过校正的多视点立体图像的基础上,通过块视差匹配以及稀疏视差匹配的方法确定立体图像的视差范围,并根据自由立体显示器的视差范围,进行视差范围的映射以及零视差位置的重新调整。本文的主要工作和取得主要成果如下:1、提出了一种新的针对平行配置模式的多摄像机阵列校正方法。该方法考虑在尽量减少图像失真的前提下,兼顾了系统实时采集的要求。具体做法是:先对平行阵列摄像机进行标定得到摄像机矩阵,再对摄像机矩阵的内参数和外参数分别使用不同的校正方法得到平行摄像机阵列理想的内、外参数;然后将原来的摄像机位置重投影到新的空间位置,从而实现对平行摄像机阵列采集获得的多视点立体图像的校正。该方法以尽可能地减小图像的几何失真为标准,能为后续的处理步骤做好准备。2、提出了一种新的针对平行配置模式的多摄像机阵列的零视差校正方法。该方法以立体图像舒适观看为前提,充分考虑了人眼、摄像机和显示器在观看舒适时的不同的视差特性,摒弃了以前仅根据平均正负视差范围进行零视差校正的做法,采用了更符合舒适观看的零视差映射方法,为多摄像机阵列的零视差校正建立一个参考准则;同时该方法还充分考虑了实时性的需要,在精度和速度间进行权衡,在保证零视差校正的精度基础上,达到了系统实时的要求。实验结果表明:本文所提出的方法可以实现对采集中的多视点立体视频进行实时的几何校正和零视差校正,并能支持八视点自由立体视频的实时显示。

【Abstract】 Free viewpoint television as the most important multi-view imaging applicationsprovide users the ability to interactively select scene viewing angle, breaking therestrictions which can only be viewed from the camera viewpoint, and enhance theuser experience provided by traditional media. Now it is more and more widespreadconcerned. This thesis ifrst introduces the development of multi-viewauto-stereoscopic television technology at home and abroad, and then proposed aminimum distortion rectiifcation algorithm as the pre-processing method forzero-parallax rectiifcation, a sparse disparity range is generated by blocksegmentation, block matching algorithm and sparse matching algorithm, and ifnallyremaps the original parallax range determined by the parallel cameras array to aproper parallax range according to the research of3D viewing comfort, which greatlyimprove the auto-stereoscopic viewing experience, major achievements are asfollows:(1)The thesis presents a new rectiifcation method for calibrated multi-viewimages based on parallel conifguration mode to reduce geometric distortion. Theoriginal images are re-projected to ideal images which fulifll the conditions withoutvertical parallax by devising an algorithm according to the intrinsic and externalparameters of camera.(2)The thesis also proposes a new rectiifcation method for zero parallax to takeadvantage of the parallax distribution characteristics of human eyes,cameras andauto-stereoscopic displays based on recent researches on the areas of3D viewingcomfort to improve the3D viewing experience. All the algorithms are devised to meetthe needs of real-time implement of multi-view video capture system. They are thecompromise between the precision of calculation and the speed of execution.Experimental results show that the method can implement image rectiifcation andzero parallax rectiifcation in real-time for the multi-view images and support eightviewpoints with naked eyes, and avoid the errors of vertical parallax and improperzero parallax, and improve the effect of auto-stereoscopic displaying.

【关键词】 多视点几何校正零视差校正标定
【Key words】 Multi-viewRectiifcationZero parallaxCalibrated
  • 【网络出版投稿人】 天津大学
  • 【网络出版年期】2015年 02期
节点文献中: