The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 15, 2026

Filed:

Jul. 29, 2025
Applicant:

Snowflake Inc., Bozeman, MT (US);

Inventors:

Yuxiong He, Redmond, WA (US);

Mert Hidayetoglu, Palo Alto, CA (US);

Aurick Qiao, Pittsburgh, PA (US);

Samyam Rajbhandari, Sammamish, WA (US);

Assignee:

Snowflake Inc., Bozeman, MT (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 9/50 (2006.01); G06F 11/34 (2006.01); G06F 17/16 (2006.01); G06N 3/02 (2006.01); G06N 3/098 (2023.01); G06N 5/04 (2023.01); G06N 20/00 (2019.01);
U.S. Cl.
CPC ...
G06F 9/5011 (2013.01); G06F 9/5066 (2013.01); G06F 11/3433 (2013.01); G06N 3/098 (2023.01); G06N 5/04 (2013.01); G06F 17/16 (2013.01); G06N 3/02 (2013.01); G06N 20/00 (2019.01);
Abstract

Various example embodiments described herein provide for systems, methods, devices, instructions, and the like that performs inference operations on an individual AI model using dynamically selected parallelism, where the parallelism selection can be based on one or more computational workload conditions associated with the individual AI model. For example, the AI model system of some example embodiments switches between two or more different parallelism modes of operation with respect to an individual AI model based on one or more inference request patterns or based on one or more batch characteristics of a set of inference requests received by the AI model system.


Find Patent Forward Citations

Loading…