Qualcomm Incorporated

Hoang Cong Minh Le

Amir Said

Reza Pourreza

Yang Yang

Taco Sebastiaan Cohen

Yinhao Zhu

Auke Joris Wiggers

Yizhe Zhang

Abhijit Khobare

Liang Zhang

Ties Jehan Van Rozendaal

Guillaume Konrad Sautiere

Muralidhar Reddy Akula

Krishna Buska

Tushar Singhal

Anjuman Raha

Frank Steven Mayer

An example computing device may include memory and one or more processors. The one or more processors may be configured to parallel entropy decode encoded video data from a received bitstream to generate entropy decoded data. The one or more processors may be configured to predict a motion vector based on the entropy decoded data. The one or more processors may be configured to decode a motion vector residual from the entropy decoded data. The one or more processors may be configured to add the motion vector residual and motion vector. The one or more processors may be configured to warp previous reconstructed video data with an overlapped block-based warp function using the motion vector to generate predicted current video data. The one or more processors may be configured to sum the predicted current video data with a residual block to generate current reconstructed video data.

Efficient warping-based neural video codec

A processor-implemented method for video compression using an artificial neural network (ANN) includes receiving a video via the ANN. The ANN extracts a first set of features of a current frame of the video and a second set of features of a reference frame of the video. The ANN determines an estimate of correlation features between the first set of features of the current frame and the second set of features of the reference frame. The estimate of the correlation features are encoded and transmitted to a receiver.

Flow-agnostic neural video compression

Systems and techniques are provided for coding (e.g., encoding and/or decoding) video data using camera motion information. For example, a decoding device can obtain a frame of encoded video data associated with an input frame, the frame of encoded video data including camera information associated with generating the video data and a residual. A camera motion compensated frame can be generated based on a reference frame and the camera information. Optical flow information associated with object motion determined based on at least the input frame and the reference frame can be generated. A motion compensated frame can be generated by warping the camera motion compensated frame based on the optical flow information. A reconstructed input frame can be generated based on the motion compensated frame and the residual.

Video coding using camera motion compensation and object motion compensation

Systems and techniques are provided for coding video data based on an optical flow correction and a residual correction. For example, a decoding device can obtain a frame of encoded video data associated with an input frame, the frame of encoded video data including an optical flow correction and a residual correction. A predicted optical flow can be generated based on one or more reference frames and a reference optical flow. A corrected prediction frame can be generated based on the predicted optical flow and the optical flow correction. A predicted residual can be generated based on at least the corrected prediction frame and a first reference frame included in the one or more reference frames. The decoding device can generate a reconstructed input frame based on the corrected prediction frame, the predicted residual, and the residual correction.

Video coding using optical flow and residual predictors

A processor-implemented method for image compression using an artificial neural network (ANN) includes receiving, at an encoder of the ANN, an image and a spatial segmentation map corresponding to the image. The spatial segmentation map indicates one or more regions of interest. The encoder compresses the image according to a controllable spatial bit allocation. The controllable spatial bit allocation is based on a learned quantization bin size.

Neural image compression with controllable spatial bit allocation

A method of image compression includes receiving an image. Multiple quantized latent representations are generated to represent features of the image. Each of the quantized latent representations has a different resolution and is generated at staggered timings. Each of the later generated quantized latent representations is conditioned on each of the prior generated quantized latent representations. The multiple quantized latent representations are decoded to reconstruct the image.

Data compression with a multi-scale autoencoder

Growing community of inventors

La Jolla, CA, United States of America

Hoang Cong Minh Le