Estimation-theoretic approach to delayed prediction in scalable video coding

Scalable video coding (SVC) employs inter-frame prediction at the base and/or the enhancement layers. Since the base layer can be encoded/decoded independent of the enhancement layers, we consider here the potential gains when prediction at the enhancement layers is delayed to accumulate and incorporate additional future information from the base layer. We build on two basic estimation-theoretic (ET) approaches developed by our group: an ET approach for enhancement layer prediction that optimally combines current base layer with prior enhancement layer information, and our recent ET approach for delayed decoding. The proposed technique fully exploits all the available information from the base layer, including any future frame information, and past enhancement layer information. It achieves considerable gains over zero-delay techniques including both standard SVC, and SVC with optimal ET prediction (but with zero encoding delay).

1. INTRODUCTION

Advances in video coding technology and novel network infrastructures enable video applications such as multi-cast that cater to multiple receivers over diverse communication channels which support different bit-rates. Scalable video coding (SVC), where the video is encoded in multiple layers, some of which may be dropped to adjust the transmission rate, is an attractive solution for these applications [1]. It eliminates the need for redundant versions of the video, coded at different bit-rates, to be stored on the server, and allows rate adjustment decisions to be made at intermediate network nodes.