The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jan. 09, 2024
Filed:
Sep. 29, 2021
Commissariat a L'energie Atomique ET Aux Energies Alternatives, Paris, FR;
Mohamed Sana, Grenoble, FR;
Nicola Di Pietro, Grenoble, FR;
Emilio Calvanese Strinati, Grenoble, FR;
Benoît Miscopein, Grenoble, FR;
Abstract
A method for associating user equipment with base stations of a cellular network, in particular of a heterogeneous network such as a 5G network, uses a multi-agent reinforcement learning (MARL) algorithm. When a user equipment enters the network, the agent associated with this equipment downloads the instance of an association meta model to a coordinating unit, pre-trained by means of reinforcement learning. The agent subsequently constructs a local observation vector, comprising observables relating to the user equipment, and a global observation vector, including observables relating to the environment of this equipment. The local and global observation vectors are projected into the same reference space, the concatenation of the vectors thus projected encoding the state of the agent. It deduces from the model and from this state, an association decision. The model is updated according to a policy gradient method to consider evolution of the environment of the user.