The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Mar. 17, 2026
Filed:
Aug. 26, 2022
Siemens Corporation, Washington, DE (US);
Ting-Han Fan, Princeton, NJ (US);
Yubo Wang, Princeton, NJ (US);
Ulrich Muenz, Princeton, NJ (US);
Mathias Hakenberg, Plainsboro, NJ (US);
Siemens Corporation, Washington, DC (US);
Abstract
A computer-implemented method for supporting execution of batch production by a production system includes, over a sequence of steps: acquiring a system state defined by a shop floor status, inventory status and a demand of the product types, and processing the system state using a reinforcement learned policy including a deep learning model to output a control action defining an integer batch size of a selected product type. The control action is determined by using learned parameters of the deep learning model to compute logits for a categorical distribution of predicted product types and a categorical distribution of predicted batch sizes from the system state. The logits are processed to transform the categorical distribution of predicted product types into an encoding of the selected product type and reduce the categorical distribution of predicted batch sizes into an integer batch size, for producing a next batch on the shop floor.