一种深度图的时域下采样编码及重建方法

doi:10.3969/j.issn.1001-2400.2016.04.028

Abstract

Abstract:

In order to improve the coding efficiency of a three-dimensional video system, a depth temporal subsampling based coding method for the intermediate view is proposed. In this paper, the manner of how to discard depth frames is firstly determined. Then, those discarded depths are reconstructed utilizing temporal consistency and multiview correspondences. Finally, in order to further improve the quality of the reconstructed depth, the wiener filter is implemented on the reconstructed results. Filter coefficients and indicators for selecting the depth predictor should be transmitted to the decoder. Experimental results demonstrate that a maximum 0.229dB and average 0.130dB peak signal-to noise ratio (PSNR) gain could be achieved for the virtual view reconstructed by the decoder while maintaining the same coding bit rate, and that the coding efficiency can be improved.

Key words: video coding, stereo image processing, depth temporal subsampling, temporal consistency, multiview correspondences

GE Chuan;LIU Ju;YUAN Hui;XIAO Yifan;LI Fengrong. Temporal subsampling based depth maps coding and the reconstruction method[J].Journal of Xidian University, 2016, 43(4): 160-165+171.

References

［1］ GE C, LIU J, YUAN H. Optimizing Rate Allocation between Multiview Videos and Associated Depth Maps with Quantization-based Virtual View Distortion Model and Genetic Algorithm ［J］. Journal of Electronic Imaging, 2014, 23(6): 063016.
［2］马祥, 霍俊彦, 任光亮, 等. 利用视频和深度图相关性的深度图帧内编码［J］. 西安电子科技大学学报, 2015, 42(3): 1-7.
MA Xiang, HUO Junyan, REN Guangliang, et al. Depth Map Intra Coding Based on Correlation Between Video and Depth Maps ［J］. Journal of Xidian University, 2015, 42(3): 1-7.
［3］ FEHN C. Depth-image-based Rendering (DIBR), Compression, and Transmission for a New Approach on 3D-TV ［C］//Proceedings of SPIE: 5291. Bellingham: SPIE, 2004: 93-104.
［4］ YUAN H, KWONG S, GE C, et al. Interview Rate Distortion Analysis-Based Coarse to Fine Bit Allocation Algorithm for 3-D Video Coding［J］. IEEE Transactions on Broadcasting, 2014, 60(4): 614-625.
［5］ YUAN H, KWONG S, LIU J, et al. A Novel Distortion Model and Lagrangian Multiplier for Depth Maps Coding ［J］. IEEE Transactions on Circuits and Systems for Video Technology, 2014, 24(3): 443-451.
［6］ YUAN H, LIU J, LI Z, et al. Virtual View Oriented Distortion Criterion for Depth Maps Coding ［J］. Electronics Letters, 2012, 48(1): 23-25.
［7］ GRAZIOSI D B, RODRIGUES N M M, PAGLIARI C L, et al. Compressing Depth Maps using Multiscale Recurrent Pattern Image Coding［J］. Electronics Letters, 2010, 46(5): 340-341.
［8］ OH K, YEA S, VETRO A, et al. Depth Reconstruction Filter and Down/Up Sampling for Depth Coding in 3-D Video［J］. IEEE Signal Processing Letters, 2009, 16(9):747-750.
［9］ EKMEKCIOGLU E, WORRALL S T, KONDOZ A M. A Temporal Subsampling Approach for Multiview Depth Map Compression［J］. IEEE Transactions on Circuits and Systems for Video Technology, 2009, 19(8): 1209-1213.
［10］ LIU C. Beyond Pixels: Exploring New Representations and Applications for Motion Analysis ［D］. Cambridge: Massachusetts Institute of Technology, 2009.
［11］ YUAN H, LIU J, XU H, et al. Coding Distortion Elimination of Virtual View Synthesis for 3D Video System: Theoretical Analyses and Implementation ［J］. IEEE Transactions on Broadcasting, 2012, 58(4): 558-568.
［12］ JOINT COLLABORATIVE TEAM FOR 3DV. 3D-HTM Software Platform［EB/OL］. ［2015-06-13］. https://hevc.hhifraunhofer.de/svn/svn_3DVCSoftware/tags/.
［13］ BJONTEGAARD G. Calculation of Average PSNR Differences between RD-curves ［C］//Processings of 13th Meeting of the ITU-T Video Coding Experts Group. Austin: ACEG, 2001:1-4.

[1]	TONG Ming;WU Yangcheng;ZHANG Jianlong;LUAN Yingzi. Multiple watermarking framework of video content oriented AVS [J]. J4, 2013, 40(4): 6-13.
[2]	WU Wei;CHEN Jian;SONG Bin. Novel video coding distortion estimation algorithm for H.264/AVC [J]. J4, 2013, 40(3): 1-6+35.
[3]	QIN Hao;QU Bei;SONG Bin;YANG Mingming. Rate control algorithm for the Wyner-Ziv frame for no-feedback distributed video coding [J]. J4, 2012, 39(4): 33-38+93.
[4]	XIAO Song;LIU Ting;DU Jianchao;LU Ji. Improved 3D fine granularity priority ordering method for the scalable video bit stream [J]. J4, 2012, 39(2): 73-79.
[5]	TONG Ming；XU Ting；ZHANG Jianlong. Video dual watermarking method for resisting geometric attacks based on low-dimensional manifold [J]. J4, 2011, 38(3): 13-19.
[6]	TONG Ming;QIN Kezhen;JI Hongbing. Video semantics robust watermarking method for the AVS compressed domain [J]. J4, 2011, 38(1): 28-33+46.
[7]	YUAN Hui;CHANG Yi-lin;LU Zhao-yang;LI Ming. Intra prediction method for reducing prediction mode information [J]. J4, 2010, 37(6): 981-986+1016.
[8]	LI Ming;CHANG Yi-lin;YANG Fu-zheng;WAN Shuai. Adaptive quantization parameter determination for key frames [J]. J4, 2010, 37(3): 396-404+435.
[9]	DENG Yun1;2;PENG Qiang1;ZHU Chang-qian1. Adaptive leaky factor selection algorithm for AR-FGS [J]. J4, 2008, 35(6): 1115-1120.
[10]	FENG Ying;WU Cheng-ke. Fast motion estimation algorithm in spatial enhancement layer based on SVC [J]. J4, 2007, 34(5): 697-701.
[11]	YANG Fu-zheng(1);CHANG Yi-lin(1);WANG Xin-dai(1);WANG Jing(2). A novel method for video error concealment based on watermark [J]. J4, 2005, 32(1): 16-20.

Temporal subsampling based depth maps coding and the reconstruction method

PDF (PC)

Like

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 11

Metrics

Comments

Recommended 10