针对不同区域对绘制虚拟视点图像质量产生不同的影响,以及深度估计不准确导致时域抖动效应影响压缩效率的问题,提出了一种面向虚拟视点图像绘制的深度图压缩算法。通过彩色图像帧差、深度图边缘提取等相关处理过程,提取深度图的静态区域、边缘区域以及动态区域。对深度图边缘区域使用了较低的量化系数,以提高深度图边缘区域编码质量;根据深度图各个区域的编码模式特点,仅对部分编码模式而不是所有模式进行率失真优化搜索,以提高深度图的编码速度;对于深度图P帧的静态区域,合理地采用了SKIP模式,以消除由于深度估计算法的局限性导致时域抖动效应对深度图压缩的影响。实验结果表明,与传统的H.264编码方案相比,本文方案在传输码流大小基本不变的前提下提高了最终虚拟视点图像边缘区域的绘制质量,其余区域主观质量相近,而深度图编码时间则节省了约77~87%。
Different regions of depth map may make different impacts on synthesized virtual views,and temporal jitter at the background of depth map due to inaccuracy of depth estimation algorithm may decrease the coding efficiency of depth map.Based on the facts,a virtual view rendering-oriented depth map coding algorithm is proposed.Frame differences of color image,edge detection on depth map are firstly utilized to segment still regions,edge regions and motion regions in depth map.The smaller quantization parameter is assigned to edge regions to protect the depth accuracy of such regions.According to features of encoding modes at different regions,partial encoding modes instead of all modes will be traversed by rate-distortion optimization process to speed up the encoding time.For still regions,SKIP mode is used reasonably to eliminate the jitter effect.Experimental results show that compared with traditional H.264 codec,the proposed algorithm improves the quality of edge regions,preserves the quality of other regions of synthesized virtual views at almost the same bitrate,and saves up to 77% to 87% of encoding time.