Deepmind Technologies Limited

Google Inc.

Arun Sarath Nair

Mustafa Suleyman

Benjamin Kenneth Coppin

Koray Kavukcuoglu

David Silver

Volodymyr Mnih

Samuel Blackwell

Vedavyas Panneershelvam

Praveen Deepak Srinivasan

Rory Fearon

Cagdas Alcicek

Alessandro De Maria

Andrei-Alexandru Rusu

Marek Barwinski

Chia-Yueh Carlton Chu

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for distributed training of reinforcement learning systems. One of the methods includes receiving, by a learner, current values of the parameters of the Q network from a parameter server, wherein each learner maintains a respective learner Q network replica and a respective target Q network replica; updating, by the learner, the parameters of the learner Q network replica maintained by the learner using the current values; selecting, by the learner, an experience tuple from a respective replay memory; computing, by the learner, a gradient from the experience tuple using the learner Q network replica maintained by the learner and the target Q network replica maintained by the learner; and providing, by the learner, the computed gradient to the parameter server.

Distributed training of reinforcement learning systems

A method for processing an image to generate a signature which is characteristic of a pattern within said image. The method comprising receiving an image; overlaying a window at multiple locations on said image to define a plurality of sub-images within said image, with each sub-image each having a plurality of pixels having a luminance level; determining a luminance value for each said sub-image, wherein said luminance value is derived from said luminance levels of said plurality of pixels; and combining said luminance values for each of said sub-images to form said signature. Said combining is such that said signature is independent of the location of each sub-image. A method of creating a database of images using said method of generating signatures is also described.

Method and apparatus for image processing

The present invention relates to a method and system for characterizing an image. The characterization may then be used to conduct a search for similar images, for example using a learning system trained using previously characterized images. A face may be identified within the image and a subsection extracted from said image which does not contain said face. At least one fixed size patch is taken from said extracted subsection; and input into said learning network to characterize said image.

Method and apparatus for characterizing an image

A method is described for processing an image to generate a signature which is characteristic of a pattern within the image. The method includes: receiving an image; overlaying a window at multiple locations on the image to define a plurality of sub-images within the image, with each sub-image each having a plurality of pixels having a luminance level; determining a luminance value for each sub-image where the luminance value is derived from the luminance levels of the plurality of pixels; and combining the luminance values for each of the sub-images to form the signature. The combining is such that the signature is independent of the location of each sub-image. A method of creating a database of images using the method of generating signatures is also described.

Growing community of inventors

London, United Kingdom

Arun Sarath Nair