Qualcomm Incorporated

Hoang Cong Minh Le

Reza Pourreza

Amir Said

Yang Yang

Taco Sebastiaan Cohen

Yinhao Zhu

Yizhe Zhang

Auke Joris Wiggers

Systems and techniques are provided for coding (e.g., encoding and/or decoding) video data using camera motion information. For example, a decoding device can obtain a frame of encoded video data associated with an input frame, the frame of encoded video data including camera information associated with generating the video data and a residual. A camera motion compensated frame can be generated based on a reference frame and the camera information. Optical flow information associated with object motion determined based on at least the input frame and the reference frame can be generated. A motion compensated frame can be generated by warping the camera motion compensated frame based on the optical flow information. A reconstructed input frame can be generated based on the motion compensated frame and the residual.

Video coding using camera motion compensation and object motion compensation

Systems and techniques are provided for coding video data based on an optical flow correction and a residual correction. For example, a decoding device can obtain a frame of encoded video data associated with an input frame, the frame of encoded video data including an optical flow correction and a residual correction. A predicted optical flow can be generated based on one or more reference frames and a reference optical flow. A corrected prediction frame can be generated based on the predicted optical flow and the optical flow correction. A predicted residual can be generated based on at least the corrected prediction frame and a first reference frame included in the one or more reference frames. The decoding device can generate a reconstructed input frame based on the corrected prediction frame, the predicted residual, and the residual correction.

Video coding using optical flow and residual predictors

A processor-implemented method for image compression using an artificial neural network (ANN) includes receiving, at an encoder of the ANN, an image and a spatial segmentation map corresponding to the image. The spatial segmentation map indicates one or more regions of interest. The encoder compresses the image according to a controllable spatial bit allocation. The controllable spatial bit allocation is based on a learned quantization bin size.

Neural image compression with controllable spatial bit allocation

A method of image compression includes receiving an image. Multiple quantized latent representations are generated to represent features of the image. Each of the quantized latent representations has a different resolution and is generated at staggered timings. Each of the later generated quantized latent representations is conditioned on each of the prior generated quantized latent representations. The multiple quantized latent representations are decoded to reconstruct the image.

Growing community of inventors

La Jolla, CA, United States of America

Hoang Cong Minh Le