The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
May. 12, 2026
Filed:
Jun. 07, 2021
Google Llc, Mountain View, CA (US);
Carlos Riquelme Ruiz, Zurich, CH;
André Susano Pinto, Zurich, CH;
Joan Puigcerver, Zurich, CH;
Basil Mustafa, Zurich, CH;
Neil Matthew Tinmouth Houlsby, Zurich, CH;
Sylvain Gelly, Kilchberg, CH;
Cedric Benjamin Renggli, Uster, CH;
Daniel Martin Keysers, Stallikon, CH;
GOOGLE LLC, Mountain View, CA (US);
Abstract
Generally, the present disclosure is directed to systems and methods that provide a simple, scalable, yet effective strategy to perform transfer learning with a mixture of experts (MoE). In particular, the transfer of pre-trained representations can improve sample efficiency and reduce computational requirements for new tasks. However, representations used for transfer are usually generic, and are not tailored to a particular distribution of downstream tasks. In contrast, example systems and methods of the present disclosure use expert representations for transfer with a simple, yet effective, strategy.