Disparity vector based advanced inter-view prediction in 3D-HEVC

Coding multiview video content often benefits significantly from disparity compensation. More advanced inter-view predictions, to predict e.g., motion vectors and residues among views require disparity vector to identify blocks in different views corresponding to the same objects. Block-level disparity vectors in typically approaches are either transmitted thus with additional overhead, or predicted with sophisticated algorithms. This paper describes a new method to derive disparity vectors, based on which advanced inter-view predictions can be better supported. The proposed method derives a disparity vector of a block only from spatial and temporal neighboring blocks. It was implemented and adopted into the 3D-HEVC codec, which is currently developed by Joint Collaborative Team on 3D Video coding development (JCT-3V). Experimental results show that with the proposed method, advanced inter-view prediction in 3D-HEVC provides in average 5.2% bitrate saving of the overall bitrate, for multiview video coding.

I Introduction

3D video coding becomes desirable with the advances in acquisition and display technologies to support 3D applications such as auto-stereoscopic 3D TV [1] and free-viewpoint video [2] and the accomplishment of the new 2D video standard, High Efficiency Video Coding (HEVC), developed by the Joint Collaborative Team on Video Technologies (JCT-VC) between Motion Picture Experts Group (MPEG) and ITU-T. To better support various stereoscopic or 3D video applications, MPEG has started the 3D video (3DV) standardization efforts, which are currently continued in JCT on 3D Video coding (JCT-3V). JCT-3V develops 3DV standards based on H.264/AVC or HEVC [3]. 3D-HEVC [4] is one of the standard tracks based on HEVC, and targets at developing coding tools for both texture views and depth views. In 3D-HEVC, texture views are coded independently from depth views to support the stereo compatibility.