The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Nov. 17, 2026

Filed:

Dec. 13, 2023
Applicant:

Cognizant Technology Solutions Us Corp, Teaneck, NJ (US);

Inventors:

Garrett Bingham, Palo Alto, CA (US);

Risto Miikkulainen, Stanford, CA (US);

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/048 (2023.01); G06N 3/08 (2023.01);
U.S. Cl.
CPC ...
G06N 3/08 (2013.01);
Abstract

A method and system for optimizing activation functions to improve efficiency of neural networks is provided. Activation function benchmark datasets are created by training neural network architectures with a plurality of activation functions. The activation function benchmark datasets comprise results obtained through the training for various tasks. Features indicative of performance of the activation functions in the activation benchmark datasets are identified. A metric space is created by analyzing identified features of activation functions, which is a low-dimensional representation of the activation functions. Activation functions are optimized based on metric space by employing dimensionality reduction techniques to visualize the metric space. Subsequently, characteristics of optimized activation functions which are predictive of performance are determined. Activation functions are selected from optimized activation, which are applied to improve real-world tasks carried out by neural networks.


Find Patent Forward Citations

Quick Actions:

Bingham, Garrett. (2026). Method and system for optimizing activation functions in neural networks (U.S. Patent No. 12801917). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/12801917

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…