Google Inc.

Oleg Veryovka

Chun-Te Chu

Mira Leung

Kara Vaillancourt

Claire Jaja

Geoffrey Landskov

Methods, systems, and computer-readable media for multi-model processing on resource-constrained devices. A resource-constrained device can determine, based on a battery-life for a battery of the device, whether to process input through a first model or a second model. The first model can be a gating model that is more energy efficient to execute, and the second model can be a main model that is more accurate than the gating model. Depending on the current battery-life and/or other criteria, the system can process, through the gating model, sensor input that can record activity performed by a user of the resource-constrained device. If the gating model predicts an activity performed by the user that is recorded by the sensor data, the device can process the same or additional input through the main model. Overall power consumption can be reduced with a minimum accuracy maintained over processing input only through the main model.

Processing sensor data with multi-model system on resource-constrained device

A method for embedding metadata into images and/or videos for AR experience is described. In one example implementation, the method may include generating a first image/video including an environment captured by a device and a virtually-rendered augmented reality (AR) object composited with the environment. The first image/video may be embedded with a first metadata. The method may further include generating a second image/video by modifying the first image/video. The second image/video may be embedded with a second metadata. The second metadata is generated based on the first metadata.

Growing community of inventors

Seattle, WA, United States of America

Oleg Veryovka