Inter-coding transform for autoencoders

Abstract

This disclosure provides methods, devices, and systems for video coding. The present implementations more specifically relate to autoencoders that support infer-frame coding in the latent domain. A video encoder may convert a frame of video from the pixel domain to the latent domain based on a machine learning model. For example, the machine learning model may be trained to transform the video frame into a tensor of latent attributes. In some aspects, the video encoder may combine the resulting tensor with a tensor of latent attributes associated with a previously-encoded video frame and transform the resulting tensor into a vector that includes latent attributes from both the current video frame and the previous video frame based on an inter-coding transform. More specifically, the inter-coding transform may reduce a dimensionality of the combined tensor so that the resulting vector is smaller or more compressible than the original tensor of latent attributes.