The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jan. 02, 2024
Filed:
Dec. 22, 2021
Ford Global Technologies, Llc, Dearborn, MI (US);
Harshal Maske, Farmington Hills, MI (US);
Devesh Upadhyay, Canton, MI (US);
Jim Birley, Bingham Farms, MI (US);
Dimitar Petrov Filev, Novi, MI (US);
Justin Miller, Berkley, MI (US);
Robert Bennett, Dearborn, MI (US);
Ford Global Technologies, LLC, Dearborn, MI (US);
Abstract
A method includes obtaining state information from one or more sensors of a digital twin. The method includes determining an action at the first routing control location based on the state information, where the action includes one of a pallet merging operation and a pallet splitting operation, and determining a consequence state based on the action. The method includes calculating a transient production value based on the consequence state and a transient objective function, calculating a steady state production value based on the consequence state and a steady state objective function, and selectively adjusting one or more reinforcement parameters of the reinforcement learning system based on the transient production value and the steady state production value.