Google Inc.

Marc'Aurelio Ranzato

Quoc V Le

Gregory Sean Corrado

Jonathon Shlens

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating labeled images. One of the methods includes selecting a plurality of candidate videos from videos identified in a response to a search query derived from a label for an object category; selecting one or more initial frames from each of the candidate videos; detecting one or more initial images of objects in the object category in the initial frames; for each initial frame including an initial image of an object in the object category, tracking the object through surrounding frames to identify additional images of the object; and selecting one or more images from the one or more initial images and one or more additional images as database images of objects belonging to the object category.

Generating labeled images

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for identifying objects in images. One of the methods includes receiving an input image; down-sampling the input image to generate a second image; generating a respective first score for each of the plurality of object categories; selecting an initial patch of the input image; generating a respective second score for each of the plurality of object categories; and generating a respective third score for each of the plurality of object categories from the first scores and the second scores, wherein the respective third score for each of the plurality of object categories represents a likelihood that the input image contains an image of an object belonging to the object category.

Identifying objects in images

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for identifying objects in images. One of the methods includes obtaining a first training image; down-sampling the first training image to generate a low-resolution first training image; processing the low-resolution first training image using a first neural network to generate a plurality of features of the low-resolution first training image and first scores for the low-resolution first training image; processing the first scores and the features of the low-resolution first training image using an initial patch locator neural network to generate an initial location of an initial patch of the first training image; locally perturbing the initial location to select an adjusted location for the initial patch of the first training image; and updating the current values of the parameters of the initial patch locator neural network to generate updated values using the adjusted location.

Growing community of inventors

Jersey City, NJ, United States of America

Marc'Aurelio Ranzato