吴佳忆,
陆宇,
殷海兵
杭州电子科技大学通信工程学院 杭州 310018
基金项目:浙江省自然科学基金(LY17F020027)，国家自然科学基金(61401132, 61572449)
详细信息
作者简介:周洋：男，1979年生，副教授，硕士生导师，研究方向为视频分析和三维视频编解码
吴佳忆：男，1994年生，硕士生，研究方向为视频差错控制技术
陆宇：男，1977年生，讲师，研究方向为视频压缩技术
殷海兵：男，1974年生，教授，研究方向为视频编码与压缩芯片设计
通讯作者:周洋 zhouyang_hz@126.com
中图分类号:TP391计量
文章访问数:1456
HTML全文浏览量:703
PDF下载量:31
被引次数:0
出版历程
收稿日期:2018-09-30
修回日期:2019-04-05
网络出版日期:2019-05-21
刊出日期:2019-11-01
Depth Map Error Concealment for 3D High Efficiency Video Coding
Yang ZHOU,,Jiayi WU,
Yu LU,
Haibing YIN
Institute of Telecommunication Engineering, Hangzhou Dianzi University, Hangzhou 310018, China
Funds:Zhejiang Province Natural Science Fundation (LY17F020027), The National Natural Science Foundation of China (61401132, 61572449)
摘要
摘要:基于多视点视频序列视点内、视点间存在的相关性，并结合视点间运动矢量共享技术，该文提出一种面向3维高效视频编码中深度序列传输丢包的错误隐藏算法。首先，根据3D高效视频编码(3D-HEVC)的分层B帧预测(HBP)结构和深度图纹理特征，将深度图丢失块分成运动块和静止块；然后，对于受损运动块，使用结合纹理结构的外边界匹配准则来选择相对最优的运动/视差矢量进行基于位移矢量补偿的错误掩盖，而对受损静止块采用参考帧直接拷贝进行快速错误隐藏；最后，使用参考帧拆分重组来获取新的运动/视差补偿块对修复质量较差的重建块进行质量提升。实验结果表明：相较于近年提出的对比算法，该文算法隐藏后的深度帧平均峰值信噪比(PSNR)能提升0.25～2.03 dB，结构相似度测量值(SSIM)能提升0.001～0.006，且修复区域的主观视觉质量与原始深度图更接近。
关键词:3维高效视频编码/
多视视频加深度/
匹配准则/
视差矢量/
错误隐藏
Abstract:By using the intra-view and inter-view correlations and the motion vector-sharing, a depth map error concealment approach is proposed for 3D video coding based on the High Efficiency Video Coding (3D-HEVC) to combat the packet loss of the depth video transmission. Based on the Hierarchical B-frame Prediction (HBP) structure in 3D-HEVC and textured features of the depth map, all the lost coding units are firstly categorized into two classes, i.e., motion blocks and static blocks. Then, according to the outer boundary matching criterion combining the texture structure, the optimal motion/disparity vector is chosen for the damaged motion blocks to conduct the motion/disparity compensation based error concealment. Whereas, the direct copy is applied to concealling the damaged static blocks quickly. Finally, for the concealed blocks whose qualities are not ideal, the new motion/disparity compensation blocks reconstructed by the reference frames recombination are applied to improning the qualities of those blocks. The experimental results show that the repaired depth map concealed by the proposed approach can achieve 0.25～2.03 dB gain in term of the Peak-Signal-to-Noise Ratio (PSNR) and 0.001～0.006 gain in term of Structural Similarity Index Measure(SSIM). Moreover, the subjective visual quality of the repaired area is better in lines with the original depth maps.
Key words:3D-High Efficiency Video Coding(3D-HEVC)/
Multi-view video plus depth/
Matching criterion/
Disparity vector/
Error concealment
PDF全文下载地址:
https://jeit.ac.cn/article/exportPdf?id=ffb5b1cb-bfe3-4de9-9927-75d4460474b4
