The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jun. 03, 2025
Filed:
Sep. 26, 2021
Siemens Aktiengesellschaft, Munich, DE;
Zi Jian Wang, Beijing, CN;
Shun Jie Fan, Beijing, CN;
SIEMENS AKTIENGESELLSCHAFT, Munich, DE;
Abstract
Some embodiments of the teachings herein include a motion control method. An example includes: creating a motion control model; training an online reinforcement learning model using the model; producing feedback with a controlled object, a model control value, and an initial control value; calculating a reward using the control value and the feedback; generating a residual control value using the online reinforcement learning model based on the reward, the model control value, and the feedback; controlling motion of the object with the residual control value and the model control value; sending the motion control model, the model control value, the feedback, and the reward to the cloud; training an offline model with the motion control model, the model control value, the feedback value, and the reward; and updating the existing online model using the offline model or deploying the offline model in a motion control system without an online model.