The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Aug. 04, 2026
Filed:
Jun. 04, 2021
Gdm Holding Llc, Mountain View, CA (US);
Jean-Bastien François Laurent Grill, Paris, FR;
Florian Strub, Paris, FR;
Florent Altché, Paris, FR;
Corentin Tallec, Paris, FR;
Pierre Richemond, London, GB;
Bernardo Avila Pires, London, GB;
Zhaohan Guo, London, GB;
Mohammad Gheshlaghi Azar, London, GB;
Bilal Piot, London, GB;
Remi Munos, London, GB;
Michal Valko, Paris, FR;
GDM Holding LLC, Mountain View, CA (US);
Abstract
A computer-implemented method of training a neural network. The method comprises processing a first transformed view of a training data item, e.g. an image, with a target neural network to generate a target output, processing a second transformed view of the training data item, e.g. image, with an online neural network to generate a prediction of the target output, updating parameters of the online neural network to minimize an error between the prediction of the target output and the target output, and updating parameters of the target neural network based on the parameters of the online neural network. The method can effectively train an encoder neural network without using labelled training data items, and without using a contrastive loss, i.e. without needing 'negative examples' which comprise transformed views of different data items.