Google Inc.

Alison Lentz

Aaron Michael Donsbach

Blaise Hilary Aguera-Arcas

Daniel Ramage

Krzysztof Duleba

Rachel Lara Been

Jon Gabriel Clapper

Don Barnett

Juston Payne

Benjamin Vanik

Jess Holbrook

Joshua Denali Lovejoy

John DiMartile

Emily Anne Fortuna

Oliver Fritz Lange

Iwona Bialynicka-Birula

Li Zhang

Hugh Brendan McMahan

Robert Douglas Fritz, Iii

Benjamin J McMahan

Divya Tyamagundlu

Kristine Kohlhepp

Tim Phillip Wantland

David Matthew Jones

The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. In particular, the present disclosure provides low power frameworks for controlling image sensor mode in a mobile image capture device. On example low power frame work includes a scene analyzer that analyzes a scene depicted by a first image and, based at least in part on such analysis, causes an image sensor control signal to be provided to an image sensor to adjust at least one of the frame rate and the resolution of the image sensor.

Low power framework for controlling image sensor mode in a mobile image capture device

The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. The mobile image capture device is operable to input an image into at least one neural network and to receive at least one descriptor of the desirability of a scene depicted by the image as an output of the at least one neural network. The mobile image capture device is operable to determine, based at least in part on the at least one descriptor of the desirability of the scene of the image, whether to store a second copy of such image and/or one or more contemporaneously captured images in a non-volatile memory of the mobile image capture device or to discard a first copy of such image from a temporary image buffer without storing the second copy of such image in the non-volatile memory.

Systems and methods for selective retention and editing of images captured by mobile image capture device

Methods and systems including computer programs encoded on a computer storage medium, for generating and displaying object recognition state indicators during object recognition processing of an image. In one aspect, a method includes performing object recognition on an image displayed in an application environment of an application on a user device using an object recognition model having multiple object recognition states including an identification state, where a candidate object in the image is positively identified, and one or more precursor states to the identification state, and where each of the precursor states has a different respective indicator for display within the image during the respective precursor state that visually emphasizes the candidate object and the identification state has a different respective indicator for display within the image during the identification state that visually emphasizes the positively identified object as being positively identified.

Object recognition state indicators

Methods and apparatus directed to generating one or more interactive content items based on content displayed on a computing device are described herein. In various implementations, content displayed to a user by a display of a computing device may be segmented into semantic region(s) based on respective content of the semantic region(s). User input may be received, e.g., via a biometric sensor of the computing device. The user input may indicate a desire of the user to act upon the semantic region(s). In response to the user input, interactive content item(s) corresponding to the semantic region(s) may be generated and provided for presentation to the user via output device(s) of the computing device. User interaction with a given interactive content item may cause the computing device to perform action(s) that are tailored to the semantic region that corresponds to the given interactive content item.

Generating interactive content items based on content displayed on a computing device

Display panel portion with an animated computer icon

The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. The mobile image capture device is operable to input an image into at least one neural network and to receive at least one descriptor of the desirability of a scene depicted by the image as an output of the at least one neural network. The mobile image capture device is operable to determine, based at least in part on the at least one descriptor of the desirability of the scene of the image, whether to store a second copy of such image in a non-volatile memory of the mobile image capture device or to discard a first copy of such image from a temporary image buffer without storing the second copy of such image in the non-volatile memory.

Systems and methods that leverage deep learning to selectively store images at a mobile image capture device

Growing community of inventors

Seattle, WA, United States of America

Alison Lentz