Qualcomm Technologies, Inc.

Gdm Holding LLC

Phillip Lippe

Emiel Hoogeboom

Mostafa Dehghani

Sara Magliacane

Jonathan Heek

Frank Brongers

A computer-implemented method of generating multimodal data. The method comprises using a token generation neural network to generate, autoregressively, an output sequence of multimodal tokens, and in response to a next multimodal token being a start-of-image token, generating an image using an image generation subsystem conditioned on features representing the current sequence of multimodal tokens obtained from the token generation neural network. The method further comprises processing the image to convert pixels of the image into a sequence of image tokens, each image token comprising a block encoding of values of the pixels in a different region of the image that maps a set of values of the pixels to a respective image token, and appending the sequence of image tokens to the current output sequence of multimodal tokens as the next multimodal tokens in the output sequence of multimodal tokens.

Systems and methods for generating multimodal data using a single-tower architecture with a data generation subsystem

A computer-implemented method for contrastive object representation from temporal data using an artificial neural network (ANN) includes receiving, by the ANN, a video. The video comprises a temporal sequence of frames including images of one or more objects. The ANN generates object representations corresponding to the one or more objects based on temporal data of multiple frames of the temporal sequence of frames. The object representations are communicated to a receiver.

Contrastive object representation learning from temporal data

Growing community of inventors

Amsterdam, Netherlands

Phillip Lippe