Google Inc.

Waymo LLC

Austin Charles Stone

Alexey Dosovitskiy

Neil Matthew Tinmouth Houlsby

Dirk Weissenborn

Alexey Alexeevich Gritsenko

Matthias Johannes Lorenz Minderer

Anelia Angelova

Alper Ayvaci

Sara Sabour Rouh Aghdam

Georg Heigold

Daniel Rudolf Maurer

Gamaleldin Elsayed

Rico Jonschkowski

Thomas Kipf

Aravindh Mahendran

Klaus Greff

A method includes obtaining first feature vectors and second feature vectors representing contents of a first and second image frame, respectively, of an input video. The method may also include generating, based on the first feature vectors, first slot vectors, where each slot vector represents attributes of a corresponding entity as represented in the first image frame, and generating, based on the first slot vectors, predicted slot vectors including a corresponding predicted slot vector that represents a transition of the attributes of the corresponding entity from the first to the second image frame. The method may additionally include generating, based on the predicted slot vectors and the second feature vectors, second slot vectors including a corresponding slot vector that represents the attributes of the corresponding entity as represented in the second image frame, and determining an output based on the predicted slot vectors or the second slot vectors.

Conditional object-centric learning with slot attention for video and other sequential data

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for object detection. In one aspect, a method comprises: obtaining: (i) an image, and (ii) a set of one or more query embeddings, wherein each query embedding represents a respective category of object; processing the image and the set of query embeddings using an object detection neural network to generate object detection data for the image, comprising: processing the image using an image encoding subnetwork of the object detection neural network to generate a set of object embeddings; processing each object embedding using a localization subnetwork to generate localization data defining a corresponding region of the image; and processing: (i) the set of object embeddings, and (ii) the set of query embeddings, using a classification subnetwork to generate, for each object embedding, a respective classification score distribution over the set of query embeddings.

Open-vocabulary object detection in images

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network to predict optical flow. One of the methods includes obtaining a batch of one or more training image pairs; for each of the pairs: processing the first training image and the second training image using the neural network to generate a final optical flow estimate; generating a cropped final optical flow estimate from the final optical flow estimate; and training the neural network using the cropped optical flow estimate.

Unsupervised training of optical flow estimation neural networks

Growing community of inventors

San Francisco, CA, United States of America

Austin Charles Stone