Google Inc.

Andrew Yan-Tak Ng

Yang Song

Charles Joseph Rosenberg

Bo Chen

Rajat Monga

Xiaoyun Wu

Systems and methods are disclosed for distributed first- or higher-order model fitting algorithms. Determination of the parameter set for the objective function is divided into a plurality of sub-processes, each performed by one of a plurality of worker computers. A master computer coordinates the operation of the plurality of worker computers, each operating on a portion of the parameter set such that no two worker computers contain exactly the same parameter subset nor the complete parameter set. Each worker computer performs its sub-processes on its parameter subset, together with training data. For maximum efficiency, the sub-processes are performed using a compact set of instruction primitives. The results are evaluated by the master computer, which may coordinate additional sub-process operations to perform higher-order optimization or terminate the optimization method and proceed to formulation of a model function.

Distribution of parameter calculation for iterative optimization methods

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for creating an image similarity model. In one aspect, a method includes obtaining feature vectors for images in a set of images, and determining first similarity measures for unlabeled images relative to a reference image. The first similarity measures are independent of first similarity feedback between the unlabeled images and the reference image. The unlabeled images are ranked based on the first similarity measures, and a weighted feature vector is generated based, in part, on the ranking. Second similarity measures are determined, independent of second similarity feedback, for labeled images and a second reference image. The labeled images are ranked based on the second similarity measures. The weighted feature vector is adjusted based, in part, on a comparison of the ranking to a second ranking of the labeled images that is based on the second similarity feedback.

Growing community of inventors

Palo Alto, CA, United States of America

Andrew Yan-Tak Ng