An Improvement of MPEG-4 Rate Control Algorithm

Frame skipping in low bit video coding could significantly reduce the visual quality of reconstructed video. At the same time, if the complexity of the video sequence remains high for a long period, then driving up the long term average bit rate, the only resort of MPEG-4 Q2 rate control algorithm results in using a high quantization scale, which shows a poor visual quality of the reconstructed video. This paper analyzes the main causes of frame skipping in current MPEG-4 frame rate control scheme, and presents a new rate control algorithm based on the quadratic R-D model over a CBR channel. Key features of the present work are. 1) the bits allocated to each P-frame or B-frame are in proportion to its distance from the end of this GOP, i.e. more bits are allocated to the frames that are nearer to their reference Ⅰ -frame: 2) the target buffer level is changeable in the GOP, at the end of each GOP( five P-frames or B-frames), the target buffer level is linearly reduced from 1/2 to 1/4 of buffer size, to other frames, the target buffer level is set to 1/2 of buffer size: 3 ) a selective and judicious use of the reduced resolution mode, in addition to a modulation of the quantization scale parameter, is to control the average long term bit rate. Experimental results with different video sequences of varied complexity, encoded at low bit rates show better efficacy of the proposed algorithm than MPEG-4 Q2 rate control scheme, and the experimental results also show that the improved algorithm has significantly reduced the number of frame skipping, increased the overall PSNR, and improved the perceptual quality.     

基于加权的运动矢量恢复差错掩盖算法

为了解决视频图像在传输过程中产生运动矢量丢失问题,本文提出一种新的后处理差错掩盖算法。我们在DCT域进行边缘检测,把与丢失块相邻的图像块分为边缘块和平滑块,同时把丢失块周围的图像块运动矢量的大小和方向分成九类。结合边缘检测与运动矢量分类,我们提出一种加权运动矢量恢复算法。仿真结果表明对不同视频序列,此算法都能比传统的方法恢复出质量更高的图像。     

一种具有可分级转码能力的空时OFDM视频传输方法

结合空时OFDM和转换编码技术,提出了一种无线衰落信道下具有可分级转码能力的鲁棒视频传输方法.采用可分级转码器将高质量的MPEG-2压缩视频转换为低码率、低分辨率MPEG-4可分级码流来满足网络带宽和终端设备显示的要求.在接收端采用一种层干扰抑制算法,使得分层空时OFDM系统不同层的传输性能存在差异,从而使系统具有不对等保护能力.根据分级码流的重要程度不同,将转码输出的可分级码流分别由分层空时编码OFDM系统的不同层来实现视频的鲁棒传输.实验结果表明:在典型的随机突发错误的无线环境下,提出的具有可分级转码能力的系统的视频传输性能优于传统的非分级转码的视频传输系统.     

Perceptual importance analysis for H.264/AVC bit allocation

The existing H.264/AVC rate control schemes rarely include the perceptual considerations. As a result, the improvements in visual quality are hardly comparable to those in peak signal-to-noise ratio （PSNR）. In this paper, we propose a perceptual importance analysis scheme to accurately abstract the spatial and temporal perceptual characteristics of video contents. Then we perform bit allocation at macroblock （MB） level by adopting a perceptual mode decision scheme, which adaptively updates the Lagrangian multiplier for mode decision according to the perceptual importance of each MB. Simulation results show that the proposed scheme can efficiently reduce bit rates without visual quality degradation.     

An error resilient scheme for H.264 video coding based on distortion estimated mode decision and nearest neighbor error concealment

Although H.264 video coding standard provides several error resilience tools, the damage caused by error propagation may still be tremendous. This work is aimed at developing a robust and standard-compliant error resilient coding scheme for H.264 and uses techniques of mode decision, data hiding, and error concealment to reduce the damage from error propagation. This paper proposes a system with two error resilience techniques that can improve the robustness of H.264 in noisy channels. The first technique is Nearest Neighbor motion compensated Error Concealment (NNEC) that chooses the nearest neighbors in the reference frames for error concealment. The second technique is Distortion Estimated Mode Decision (DEMD) that selects an optimal mode based on stochastically distorted frames. Observed simulation results showed that the rate-distortion performances of the proposed algorithms are better than those of the compared algorithms.     

Rate Control for MPEG-4 Bit Stream

Totransmitthemultimediadataovertheinternet ,pre encodedvideobitstreamsarepreferablebecauseofthelimitofthenetworkbandwidth .Inmostcases ,theencodershouldknowthechannelcharacteristicsinad vanceandencodethemasparameters .Consequently ,theflexibilityisreduced .Theratecontrolisemployedtocontroltheoutputbitrateaccordingtonetworkcondi tions.Forwirelessnetworks ,theirbandwidthsaremuchmorelimitedthanwirenetworks.Soratecontrolbecomesespeciallyimportantfortransmittingmultimediaoverthewirelessdomains[1- …     

A channel distortion model for video over lossy packet networks

Error-resilient video communication over lossy packet networks is often designed and operated based on models for the effect of losses on the reconstructed video quality. This paper analyzes the channel distortion for video over lossy packet networks and proposes a new model that, compared to previous models, more accurately estimates the expected mean-squared error distortion for different packet loss patterns by accounting for inter-frame error propagation and the correlation between error frames. The accuracy of the proposed model is validated with JVT/H.264 encoded standard test sequences and previous frame concealment, where the proposed model provides an obvious accuracy gain over previous models.     

一种有效的基于运动矢量场的压缩域运动对象分割算法

In this paper an efficient compressed domain moving object segmentation algorithm is proposed, in which the motion vector (MV) field parsed from the compressed video is the only cue used for moving object segmentation. First the MV field is temporally and spatially normalized, and then accumulated by an iterative backward projection to enhance salient motions and alleviate noisy MVs. The accumulated MV field is then segmented into motion-homogenous regions using a modified statistical region growing approach. Finally, moving object regions are extracted in turn based on minimization of the joint prediction error using the estimated motion models of two region sets containing the candidate object region and other remaining regions, respectively. Experimental results on several H.264 compressed video sequences demonstrate good segmentation performance.     

Systematic lossy error protection based on H.264/AVC redundant slices and flexible macroblock ordering

INTRODUCTION In typical video transmission systems, a video signal is compressed, and the resulting bit stream is transmitted over an error-prone channel. The errors may consist of symbol errors caused by fading, as observed for wireless channels, or packet erasures caused by congestion, as observed in the Internet. If a received video packet contains errors, then the portion of the video signal contained in the packet is lost and must be concealed. Error concealment schemes alone cannot …     

A channel distortion model for video over lossy packet networks

Error-resilient video communication over lossy packet networks is often designed and operated based on models for the effect of losses on the reconstructed video quality. This paper analyzes the channel distortion for video over lossy packet networks and proposes a new model that, compared to previous models, more accurately estimates the expected mean-squared error distortion for different packet loss patterns by accounting for inter-frame error propagation and the correlation between error frames. The accuracy of the proposed model is validated with JVT/H.264 encoded standard test sequences and previous frame concealment, where the proposed model provides an obvious accuracy gain over previous models.     

基于运动矢量的鲁棒视频去抖动算法

This paper proposes a new robust video stabilization algorithm to remove unwanted vibrations in video sequences. A complete theoretical analysis is first established for video stabilization, providing a basis for new stabilization algorithm. Secondly, a new robust global motion estimation (GME) algorithm is proposed. Different from classic methods, the GME algorithm is based on spatlal-temporal filtered motion vectors computed by block-matching methods. In addition, effective schemes are employed in correction phase to prevent boundary artifacts and error accumulation. Experiments show that the proposed algorithm has satisfactory stabilization effects while maintaining good tradeoff between speed and precision.     

高斯混合模型在错误隐藏技术中的应用

把高斯混合模型(GMM)用于视频流的错误隐藏技术中,并对此进行了分析、论证、研究。GMM依据邻近的时域和空域的信息,用最小均方差来估计丢失像素的区域;如部分视频数据丢失,根据丢失视频数据邻近的时-空域信息通过GMM做一个最小均方差估计;如丢失宏块周围的时域信息也随之丢失,则采用反复迭代估计的方法来解决。和现有的基于时-空域的错误隐藏方法相比,基于GMM的错误隐藏方法提高了PSNR,且对于大范围内的丢包率都是有效的。仿真实验也证实了基于GMM的错误隐藏方法能较好地提高和改善视频的主客观质量。     

A fast block-matching algorithm based on variable shape search

INTRODUCTION Block-matching motion estimation is a key video coding technology that reduces the temporal redundancy between adjacent frames. The 3GPP/ 3GPP2 mandatory video codecs (MPEG-4 Simple Profile or H.263 Baseline) have adopted this tech- nology extensively. However, block-matching motion estimation is quite computationally intensive if the Full Search (FS) algorithm is used which exhaus- tively checks all possible candidate motion vectors within the search window. Therefore…     

一种用于TLC闪存的速率兼容LDPC码

TLC闪存存储单元随着擦写次数不断增加,错误概率快速增大。基于TLC闪存信道结构,利用原模图LDPC码字扩展以及变量节点与TLC闪存存储页匹配关系,提出了一种速率兼容原模图LDPC码,所设计的速率兼容原模图LDPC码在保持信息位长度相同情况下,可实现可变码率,能够适应TLC闪存擦除次数增多而导致的不同纠错能力需求情况,编译码时只需一对LDPC编码器/译码器即可灵活处理所有码率,从而提高编码器/译码器的硬件利用率。仿真结果表明,所提出的速率兼容原模图LDPC码优于未经过逻辑页匹配的速率兼容原模图LDPC码,当误码率为[10-4]、码率分别为0.90、0.82、0.75时,所提出的速率兼容原模图LDPC码信噪比性能比基于PEG算法的非规则LDPC码均提高0.2dB以上。     

Video quality based link adaptation for low latency video transmission over WLANs

INTRODUCTION Low latency video transmission is very de manding in terms of the performance of all layers i the protocol stack. Over the last decade, research ha focused on enhancements of each individual laye without considering cross-layer interactions. Adapt ing video coding to the channel/network condition and technologies (and vice versa) (Girod et al., 2002 via the cross-layer exchange of information has onl recently been investigated. van der Schaar et al.(200 developed a cross-laye…     

MPEG-2纹理图像的错误检测技术

基于MPEG-2码流，描述了传送流（TS）和视频流的错误检测方法。这两种错误分别由信道解码器和视频解码器识别，通常检测到的是语法错误，而且由于可变字长码的错误传播影响，检测到的错误位置并非错误的起始位置。因此，基于图像光滑性和一致性的假设，提出了非语法错误的纹理图像的检测算法（如DC系数的错误检测算法）以及确定错误起始位置的方法。实验结果表明，该技术能够应用于MPEG-2解码器的实时处理。     

Efficient video downscaling transcoder from MPEG-2 to H.264

The new H.264 video coding standard achieves significantly higher compression performance than MPEG-2. As the MPEG-2 is popular in digital TV, DVD, etc., bandwidth or memory space can be saved by transcoding those streams into H.264 in these applications. Unfortunately, the huge complexity keeps transcoding from being widely used in practical applications. This paper proposes an efficient transcoding architecture with a smart downscaling decoder and a fast mode decision algorithm. Using the proposed architecture, huge buffering memory space is saved and the transcoding complexity is reduced. Performance of the proposed fast mode decision algorithm is validated by experiments.     

基于MPEG压缩域的高速公路车辆检测方法

提出了一种从MPEG-2压缩数据流中提取高速公路车流量的方法．白天根据车辆运动的特点,利用宏块的运动矢量检测车辆,并给出了运动矢量噪声的滤除算法．夜间根据车灯的亮度高于背景区域的特点,利用图像块的DCT系数检测车辆的车灯,并介绍了P帧图像块的DCT系数的计算方法．为了防止道路外物体的移动以及镜头的移动对检测造成的影响,给出了车道定位的方法以及镜头移动检测的算法．采用此方法,白天的检测准确率可达97．4％,夜间的检测准确率可达95．4％．实验表明本检测方法是有效的．     

一种新的无线视频传输帧内刷新策略

首先分析了无线信道突发性出错和二阶Markov无线信道模型. 根据该模型和视频编码器的编码方式推导了突发性出错引起的帧内编码和帧间编码的信道失真. 然后提出了一种新的速率失真率(R-D)框架内的帧内刷新策略. 该策略一方面对无线视频传输系统的容错性能和编码效率进行了优化, 另一方面可有效阻止帧间错误传播, 减小信道失真. 在不同传输信道中的仿真结果验证了该策略在无线视频传输容错方面的性能改进.     

H.264/AVC视频容错传输的菱形FMO分布方法

图像压缩技术是基于在空域,时域或者频域上移除数据冗余的算法。它相当大地减少了数据转换率,但是随之的视频压缩信号对于传输误差更加敏感。差错恢复技术相对于通道误差增强了视频比特流的鲁棒性。在H.264/AVC的条带编码作为一种差错恢复技术之一被用于限制接收视频品质的数据丢失效应。有一种模式非常重要,它是将图像的宏块分配成不同的条带组,并能够提供不同的差错恢复标准。该文将深入分析这一类分散类型的灵活的宏块顺序(FMO)模式性能,并提出一个定义明确的系统模式,可以更完全地挖掘宏块顺序中离差概念从而克服误差损失。仿真结果显示:新的改进方案的性能优于传统模式。