Google Inc.

Eirikur Thor Agustsson

George Dan Toderici

Fabian Julius Mentzer

Michael Tobias Tschannen

Nicholas M Johnston

Troy Chinen

David Charles Minnen

Johannes Balle

Alex Sukhanov

Lucas Marvin Theis

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for compressing video data. In one aspect, a method comprises: receiving a video sequence of frames; generating, using a flow prediction network, an optical flow between two sequential frames, wherein the two sequential frames comprise a first frame and a second frame that is subsequent the first frame; generating from the optical flow, using a first autoencoder neural network: a predicted optical flow between the first frame and the second frame; and warping a reconstruction of the first frame according to the predicted optical flow and subsequently applying a blurring operation to obtain an initial predicted reconstruction of the second frame.

Video compression using optical flow

An example computer-implemented method for determining a perceptual quality of a subject video content item is provided. The example method can include inputting a subject frame set from the subject video content item into a first machine-learned model. The example method can also include generating, using the first machine-learned model, a feature based at least in part on the subject frame set. The example method can also include outputting, using a second machine-learned model, a score indicating the perceptual quality of the subject video content item based at least in part on the feature.

Method for constructing a perceptual metric for judging video quality

A computer-implemented method for compressing computer-readable data having improved efficiency can include obtaining, by a computing system including one or more computing devices, input data associated with the computing system; and encoding, by the computing system, the input data and added noise from a noisy channel to produce encoded data based at least in part on an encoder model, wherein encoding the input data and added noise includes additively combining the added noise and the input data to obtain noisy input data and rounding the noisy input data by a soft rounding function, the soft rounding function having a sharpness, to produce the encoded data, wherein the machine-learned encoder model is trained on training data, wherein the training data is encoded with the added noise from the noisy channel.

Systems and methods for improved machine-learned compression

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an encoder neural network configured to receive a data item and to process the data item to output a compressed representation of the data item. In one aspect, a method includes, for each training data item: processing the data item using the encoder neural network to generate a latent representation of the training data item; processing the latent representation using a hyper-encoder neural network to determine a conditional entropy model; generating a compressed representation of the training data item; processing the compressed representation using a decoder neural network to generate a reconstruction of the training data item; processing the reconstruction of the training data item using a discriminator neural network to generate a discriminator network output; evaluating a first loss function; and determining an update to the current values of the encoder network parameters.

Growing community of inventors

Zürich, Switzerland

Eirikur Thor Agustsson