The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jun. 02, 2026
Filed:
Jan. 07, 2025
Databricks, Inc., San Francisco, CA (US);
Vitaliy A. Chiley, San Diego, CA (US);
Shashank Rajput, San Francisco, CA (US);
Databricks, Inc., San Francisco, CA (US);
Abstract
A data processing service generates keys and values for decoder layers. The service receives a request from a client device. The service accesses a ML transformer architecture which includes decoder layers. Each decoder layer is associated with a KV-cache. The service applies the transformer architecture to input tokens obtained from the request to generate output tokens. For each decoder layer, the service generates keys and values for a current decoder layer. The keys and the values for the current decoder layer are generated by applying trained values for a set of parameters to keys and values for a previous decoder layer. The service obtains queries from inputs to the current decoder layer and generates attention outputs for the current decoder layer by combining the queries with the keys and the values for the current decoder layer. The service generates a response to the request from the output tokens.