Salesforce, Inc.

Dongxu Li

Caiming Xiong

Hung Le

Junhao Zhang

Doyen Sahoo

Embodiments described herein provide a video generation framework built on a decoupled multimodal cross-attention module to simultaneously condition the generation on both an input image and a text input. The video generation may thus be conditioned on the visual appearance of a target object reflected in the input image. In this way, zero-shot video generation may be achieved with little fine-tuning efforts.

Growing community of inventors

Singapore, Singapore

Dongxu Li