Microsoft Technology Licensing, LLC

Ruiqin Xiong

Feng Wu

Jizheng Xu

Shipeng Li

Lin Luo

Ji-Zheng Xu

Chong Luo

Hao Cui

Scaled video for pseudo-analog transmission in the spatial domain is described. Boundaries are determined for M L-shaped chunks of coefficients of at least one frequency-transformed video frame of a group of pictures (GOP). The boundaries are determined based at least on variances of the coefficients of the M L-shaped chunks, such as by reducing or minimizing the sum of the square roots of the variances of the coefficients. Corresponding power scale factors for the M L-shaped chunks are determined based at least partly on the variances of the coefficients of the M L-shaped chunks, and the coefficients of the M L-shaped chunks are scaled using the corresponding power scale factors. The pixel values of the frames (e.g., the frames in the spatial domain) are transmitted on a pseudo-analog channel. At the receiver, retained spatial redundancy enables denoising in the spatial domain prior to de-scaling in the frequency domain.

Scaled video for pseudo-analog transmission in spatial domain

Video data for a high resolution image unit is coded with regard to both a low resolution reference image unit and a high resolution reference image unit. In an example encoding implementation, both low pass information and high pass information of residue data for a current image are generated. In an example decoding implementation, a current image is reconstructed by synthesizing both low pass information and high pass information for the reconstructed image.

Spatially scalable video coding

Techniques and tools are described for scalable video coding and decoding. For example, a 3D sub-band decoder receives video encoded using spatial-domain motion-compensated temporal filtering at a first spatial resolution. The decoder decodes at least part of the video for output at a second spatial resolution lower than the first spatial resolution. The decoder uses any of several techniques to improve performance by devoting extra computational resources to the decoding, devoting extra buffer resources to storing reference picture information, and/or considering spatial high-pass sub-band information.

Spatial scalability in 3D sub-band decoding of SDMCTF-encoded video

A method for encoding motion-compensated video data includes generating, for a current frame, a high-pass wavelet coefficient based on a function of pixels in a temporally adjacent frame. The operations are repeated for multiple pixels in an array of pixels in the current frame to form an array of high-pass wavelet coefficients. A low-pass wavelet coefficient is generated based on a function of the high-pass wavelet coefficients. A system for coding video data includes a temporal wavelet decomposition module decomposing a pixel into a high-pass coefficient by performing a discrete wavelet transform on the pixel, a function of pixels in a previous frame, and/or a function of pixels in a subsequent frame. The system includes a motion estimation module generating motion vectors associated with the pixels in the previous frame and in the subsequent frame.

Barbell lifting for wavelet coding

A non-dyadic spatial scalable wavelet transform may scale an original digital video frame or digital image at a non-dyadic ratio. The digital video frame or digital image is quantized to create a set of data representing the digital video frame or digital image. The set of data is then input to the non-dyadic spatial scalable wavelet transform. The non-dyadic spatial scalable wavelet transform may then transform the data associated with a first pixel to a high-pass coefficient and use the high-pass coefficient to transform the data associated with a second and third pixel to low-pass coefficients. The low-pass coefficients may then be converted to a digital image for viewing.

Non-dyadic spatial scalable wavelet transform

A method for coding video data includes scalably generating layers of wavelet coefficients based on a frame of video data, scalably generating motion vector data associated with the plurality of layers, and combining the motion vector data and the plurality of layers of wavelet coefficients into a coded video frame representing the frame of video data. The method may further include transmitting the coded video frame. A system for coding video data includes a temporal decomposition module scalably applying a barbell function to a frame of video data, and a motion vector module scalably coding motion vector data at multiple levels of refinement.

Growing community of inventors

Beijing, China

Ruiqin Xiong