The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Sep. 08, 2026
Filed:
Aug. 01, 2024
Ford Global Technologies, Llc, Dearborn, MI (US);
Ding Zhao, Pittsburgh, PA (US);
Haohong Lin, Pittsburgh, PA (US);
Yuming Niu, Northville, MI (US);
Wenhao Ding, San Jose, CA (US);
Zuxin Liu, Mountain View, CA (US);
Kalpak Kalvit, Milpitas, CA (US);
Ford Global Technologies, LLC, Dearborn, MI (US);
Abstract
A computer that includes a processor and a memory, the memory including instructions executable by the processor to operate a system based on predictions output from the machine learning system including predicted states, actions, rewards, and costs, wherein the machine learning system includes a first transformer and a second transformer and is trained based on bisimulation offline reinforcement learning, wherein the first transformer and the second transformer are based on a Markov decision process that includes the states, the actions, the rewards, and the costs. The bisimulation offline reinforcement learning can include inputting a first sequences of training states, actions, rewards, and costs to the first transformer and a second sequence of the training states, actions, rewards, and costs to the second transformer to determine bisimulation learning objectives based on latent variables output from the first transformer and the second transformer.