The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 23, 2025

Filed:

Jan. 11, 2021
Applicant:

Google Llc, Mountain View, CA (US);

Inventors:

Irwan Bello, San Francisco, CA (US);

Barret Zoph, Sunnyvale, CA (US);

Vijay Vasudevan, Los Altos Hills, CA (US);

Quoc V. Le, Sunnyvale, CA (US);

Assignee:

Google LLC, Mountain View, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/08 (2023.01); G06N 3/044 (2023.01); G06N 3/045 (2023.01);
U.S. Cl.
CPC ...
G06N 3/08 (2013.01); G06N 3/044 (2023.01); G06N 3/045 (2023.01);
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for determining update rules for training neural networks. One of the methods includes generating, using a controller neural network, a batch of output sequences, each output sequence in the batch defining a respective update rule; for each output sequence in the batch: training a respective instance of a child neural network using the update rule defined by the output sequence; evaluating a performance of the trained instance of the child neural network on the particular neural network task to determine a performance metric for the trained instance of the child neural network on the particular neural network task; and using the performance metrics for the trained instances of the child neural network to adjust the current values of the controller parameters of the controller neural network.


Find Patent Forward Citations

Loading…