Reinforcement learning of beam codebooks for millimeter wave and terahertz mimo systems

Abstract

Reinforcement learning of beam codebooks for millimeter wave and terahertz multiple-input-multiple-output (MIMO) systems is provided. Millimeter wave (mmWave) and terahertz (THz) MIMO systems rely on predefined beamforming codebooks for both initial access and data transmission. These predefined codebooks, however, are commonly not optimized for specific environments, user distributions, and/or possible hardware impairments. To overcome these limitations, this disclosure develops a deep reinforcement learning framework that learns how to optimize the codebook beam patterns relying only on receive power measurements. The developed model learns how to adapt the beam patterns based on the surrounding environment, user distribution, hardware impairments, and array geometry. Further, this approach does not require any knowledge about the channel, radio frequency (RF) hardware, or user positions.