The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Mar. 03, 2026
Filed:
Aug. 11, 2021
Cognizant Technology Solutions U.s. Corporation, College Station, TX (US);
Garrett Bingham, Oakland, CA (US);
Risto Miikkulainen, Stanford, CA (US);
Cognizant Technology Solutions US Corp., College Station, TX (US);
Abstract
The embodiments describe a technique for customizing activation functions automatically, resulting in reliable improvements in performance of deep learning networks. Evolutionary search is used to discover the general form of the function, and gradient descent to optimize its parameters for different parts of the network and over the learning process. The new approach discovers new parametric activation functions which improve performance over previous activation functions by utilizing a flexible search space that can represent activation functions in an arbitrary computation graph. In this manner, the activation functions are customized to both time and space for a given neural network architecture.