Multiple description coding with spatial-temporal hybrid interpolation for video streaming in peer-to-peer networks

INTRODUCTION Multimedia services over the Internet are be- coming popular due to the widespread deployment of broadband access. However, the conventional cli- ent-server architecture severely limits the number of simultaneous users, especially for bandwidth inten- sive applications such as video streaming. P2P net- works, on the other hand, offer a solution to the scalability problem. As a node joins a P2P network, it not only consumes resources but also contributes its bandwidth or comp…     

Very Low Bit Rate Video Coding Using Motion Compensated 3 D Wavelet TransformVery Low Bit Rate Video Coding Using Motion Compensated 3 D Wavelet Transform

１　Ｉｎｔｒｏｄｕｃｔｉｏｎ　Ｔｈｅｐｕｂｌｉｃｓｗｉｔｃｈｅｄｔｅｌｅｐｈｏｎｅｎｅｔｗｏｒｋ（ＰＳＴＮ）ａｎｄｉｔｓｂｒｏａｄｃｏｖｅｒａｇｅｐｒｏｍｏｔｅｔｈｅｄｅｖｅｌｏｐｍｅｎｔｏｆｖａｒｉｏｕｓｖｉｓｕａｌｃｏｍｍｕｎｉｃａｔｉｏｎｓｓｅｒｖｉｃｅｓｏｖｅｒＰＳＴＮ［１］．ＴｈｅａｌｌｏｗｅｄｂｉｔｒａｔｅｏｖｅｒＰＳＴＮｗｉｔｈｖｏｉｃｅｂａｎｄｍｏｄｅｍｉｓｓｔｉｌｌｌｉｍｉｔｅｄｔｏｌｏｗｅｒｔｈａｎ６４ｋｂｉｔ／ｓ,ｗｈｉｃｈｐｒｅｓｅｎｔｓａｇｒｅａｔｃｈａｌｌｅｎｇｅ…     

Frame-layer bit allocation for multi-view video coding based on frame complexity estimation

Current multi-view video coding （MVC） reference model in joint video team （JVT） does not provide efficient rate control schemes. This paper presents a rate control algorithm for MVC by improving the quadratic rate-distortion （R-D） model. We reasonably allocate bit-rate among views based on the correlation analysisl The proposed algorithm consists of three levels to control the rate bits more accurately, of which the frame layer allocates bits according to the frame complexity and the temporal activity. Extensive experiments show that the proposed algorithm can control the bit rate efficiently.     

A parallel memory architecture for video coding

To efficiently exploit the performance of single instruction multiple data （SIMD） architectures for video coding, a parallel memory architecture with power-of-two memory modules is proposed. It employs two novel skewing schemes to provide conflict-free access to adjacent elements （8-bit and 16-bit data types） or with power-of-two intervals in both horizontal and vertical directions, which were not possible in previous parallel memory architectures. Area consumptions and delay estimations are given respectively with 4, 8 and 16 memory modules. Under a 0.18-pm CMOS technology, the synthesis results show that the proposed system can achieve 230 MHz clock frequency with 16 memory modules at the cost of 19k gates when read and write latencies are 3 and 2 clock cycles, respectively. We implement the proposed parallel memory architecture on a video signal processor （VSP）. The results show that VSP enhanced with the proposed architecture achieves 1.28× speedups for H.264 real-time decoding.     

Analysis and application of error concealment tools in AVS-M decoder

Audio Video coding Standard (AVS) is the latest audio and video coding standard of China. AVS Part 7 (also known as A VS-M) targets mobility applications where error concealment is of great importance. This paper first briefly introduces the general concept of error concealment. Then two error concealment schemes are proposed and implemented on AVS-M decoder under different test conditions. Simulation results of the schemes and suggestions on how to use these tools are also provided.     

Very low bit-rate video coding based on wavelet transform

ｖｅｌｅｔ ＴｒａｎｓｆｏｒｍTX１ＩｎｔｒｏｄｕｃｔｉｏｎＶｉｄｅｏｃｏｍｍｕｎｉｃａｔｉｏｎｉｓｂｅｃｏｍｉｎｇｉｎｃｒｅａｓｉｎｇｌｙｉｍ－ｐｏｒｔａｎｔｉｎａｐｐｌｉｃａｔｉｏｎｔｏｓｅｖｅｒａｌａｒｅａｓｓｕｃｈａｓｔｅｌｅ－ｃｏｎｆｅｒｅｎ...     

Temporal Error Concealment Technique for MPEG-4 Video Streams

Concerning inter4v mode employed widely in MPEG-4 video, a new temporal error concealment scheme for MPEG-4 video sequences is proposed, which can selectively interpolate one or four motion vectors (MVs) for the missing macroblock (MB) according to the estimated MB coding mode. Performance of the proposed scheme is compared with the existing schemes with multiple testing sequences at different bit error rates. Experimental results show that the proposed algorithm can mask the impairments caused by transmission errors more efficiently than 0 MV and average MV methods by consuming more time for different bit error rates. It has an acceptable image quality close to that obtained by the selective motion vector matching (SMVM) algorithm, while taking less than half of cycles of operations. The proposed concealment scheme is suitable for low complexity video real-time implementations.     

3 D Wavelet Transform for Very Low Bit Rate Video Coding

１ＩｎｔｒｏｄｕｃｔｉｏｎＴｈｅｌｉｍｉｔｅｄｔｒａｎｓｍｉｓｉｏｎｂａｎｄｗｉｄｔｈａｖａｉｌａｂｌｅｏｎｃｕｒｒｅｎｔｃｏｍｍｕｎｉｃａｔｉｏｎｃｈａｎｎｅｌｓｓｕｃｈａｓｐｕｂｌｉｃｓｗｉｔｃｈｅｄｔｅｌｅｐｈｏｎｅｎｅｔｗｏｒｋｓ（ＰＳＴＮ...     

3DV quality model based depth maps for view synthesis in FTV system

Depth maps are used for synthesis virtual view in free-viewpoint television (FTV) systems.When depth maps are derived using existing depth estimation methods,the depth distortions will cause undesirable artifacts in the synthesized views.To solve this problem,a 3D video quality model base depth maps (D-3DV) for virtual view synthesis and depth map coding in the FTV applications is proposed.First,the relationships between distortions in coded depth map and rendered view are derived.Then,a precisely 3DV quali...     

Very Low Bit-Rate Video Coding Using Motion ompensated 3-D Wavelet Transform

A new motion-compensated 3-D wavelet transform (MC-3DWT) video coding scheme is presented in thispaper. The new coding scheme has a good performance in average PSNR, compression ratio and visual quality of re-constructions compared with the existing 3-D wavelet transform (3DWT) coding methods and motion-compensated2-D wavelet transform (MC-WT) coding method. The new MC-3DWT coding scheme is suitable for very low bit-rate video coding.     

Very low bit-rate video coding using motion compensated 3-d wavelet transform

A new motion-compensated 3-D wavelet transform (MC-3DWT) video coding scheme is presented in this paper. The new coding scheme has a good performance in average PSNR, compression ratio and visual quality of reconstructions compared with the existing 3-D wavelet transform (3DWT) coding methods and motion-compensated 2-D wavelet transform (MC-WT) coding method. The new MC-3DWT coding scheme is suitable for very low bit-rate video coding. Project supported by the National Natural Science Foundation of China(69875009)     

High throughput bandwidth optimized VLSI design for motion compensation in AVS HDTV decoder

In this paper we present a motion compensation （MC） design for the newest Audio Video coding Standard （AVS） of China. Because of compression-efficient techniques of variable block size （VBS） and sub-pixel interpolation, intensive pixel calculation and huge memory access are required. We propose a parallel serial filtering mixed luma interpolation data flow and a three-stage multiplication free chroma interpolation scheme. Compared to the conventional designs, the integrated architecture supports about 2.7 times filtering throughput. The proposed MC design utilizes Vertical Z processing order for reference data re-use and saves up to 30% memory bandwidth. The whole design requires 44.3k gates when synthesized at 108 MHz clock frequency using 0.18-μm CMOS technology and can support up to 1920×1088@30 fps AVS HDTV video decoding.     

More efficient ground truth ROI image coding technique： implementation and wavelet based application analysis

In this paper, more efficient, low-complexity and reliable region of interest (ROI) image codec for compressing smooth low texture remote sensing images is proposed. We explore the efficiency of the modified ROI codec with respect to the selected set of convenient wavelet filters, which is a novel method. Such ROI coding experiment analysis representing low bit rate lossy to high quality lossless reconstruction with timing analysis is useful for improving remote sensing ground truth sur- veillance efficiency in terms of time and quality. The subjective [i.e. fair, five observer (HVS) evaluations using enhanced 3D picture view Hyper memory display technology] and the objective results revealed that for faster ground truth ROI coding applications, the Symlet-4 adaptation performs better than Biorthogonal 4.4 and Biorthogonal 6.8. However, the discrete Meyer wavelet adaptation is the best solution for delayed ROI image reconstructions.     

Multiple descriptions based wavelet image coding

INTRODUCTIONJPEG2 0 0 0 (LawsonandZhu ,2 0 0 2 )isanewlypublishedstillimage codinginternationalstandard .Itsintroductionmeantthatforthefirsttime,thediscretewavelettransform (DWT)wouldbeusedforthedecompositionandrecon structionofimagestogetherwithanefficientcod ingscheme.IntheJPEG2 0 0 0coder,beforeanywaveletdecompositionisperformed ,theimageispartitionedintonon overlappingtiles.Thesetilesareofequalsizeexceptpossiblyforthoseadjacenttotheimageboundary .Thenwavelettransformisappliedtotr…     

A cross-layer approach to enable multipacket transmission in MIMO-SDMA based WLAN

We propose a medium access control （MAC） protocol for uplink transmissions in wireless local area networks （WLANs）, where both stations and access points （APs） are equipped with multiple antennas. The protocol solves some common problems in utilizing multiple input multiple output （MIMO） under the 802.11 protocol, e.g., how to deploy preamble （training sequence） used for channel estimation and how to enable simultaneous data transmissions, and facilitates two simultaneous uplink data transmissions via a cross-layer approach. Furthermore, we develop a 3D discrete-time Markov model to analyze the performance of the proposed WLAN scheme. The analytical results are verified by simulation, and numerical results show that the system throughput can be significantly improved by our proposed scheme as compared with conventional schemes.     

An adaptive preprocessing algorithm for low bitrate video coding

INTRODUCTION Currently, main video coding algorithms, such as H.26x and MPEG families are all based on block discrete cosine transform (BDCT). At low bit rate, all these BDCT-based algorithms suffer from visible blocking artifacts, which are easily noticeable as the discontinuities between neighboring blocks, particu- larly in flat and low activity homogeneous areas of the image because high frequency DCT coefficients are inclined to be quantizd to zeros due to the high quan- tizatio…     

多视点视频编码预测结构的研究

不同的多视点视频序列具有不同的时空相关性,MVC采用的分层B帧预测结构无法充分利用视频序列的属性。本文提出了一种能适应不同视频序列编码的方法,通过研究多视点视频图像中的时空相关性和视点间的相关性,适当地取消部分时间层的视点间预测并且对所有P视点的非关键帧均采用视点间预测和调整了I视点的位置。实验结果表明,本文方法在提高编码效率的同时使得预测结构具有更好的随机访问性能、更低的编码复杂度。     

Rate-distortion optimized bitstream switching for peer-to-peer live streaming

Peer-to-peer （P2P） technology provides a cost-effective and scalable way to distribute video data. However, high heterogeneity of the P2P network, which rises not only from heterogeneous link capacity between peers but also from dynamic variation of available bandwidth, brings forward great challenge to video streaming. To attack this problem, an adaptive scheme based on rate-distortion optimization （RDO） is proposed in this paper. While low complexity RDO based frame dropping is exploited to shape bitrate into available bandwidth in peers, the streamed bitstream is dynamically switched among multiple available versions in an RDO way by the streaming server. Simulation results show that the proposed scheme based on RDO achieves great gain in overall perceived quality over simple heuristic schemes.     

An adaptive joint source and channel coding scheme for H.264 video multicasting over wireless LAN

INTRODUCTION Video multicasting over wireless local area net- work (WLAN) (IEEE Standard 802.11, 1997) enables the distribution of live or pre-recorded programs to many receivers efficiently. An example application is to redistribute TV programs or location-specific in- formation in hot spots such as airport. Users can watch their favorite TV programs on mobile devices while browsing the Internet. For enterprise applica- tions, an example is multicasting video of a lecture or trainin…