Dynamic Antenna Control for HAPS Using Fuzzy Q-Learning in Multi-Cell Configuration

In the 5th generation mobile communications (5G) and 5G and beyond (B5G), a high altitude platform station (HAPS) is expected to serve as a flying base station (BS) to provide communications over wide areas. In the HAPS system, a multi-cell configuration with multiple beams is considered to increase system throughput. When the HAPS is subjected to wind pressure, the cell range moves accordingly, causing degradation of received signal power and handover to the user equipment (UE). To suppress such degradation and handover, beam control of HAPS is necessary. However, it is not easy to control the beam because multiple antenna parameters affect each other and determine the cell range. In this paper, we propose a beam control method for HAPS using fuzzy Q-learning in multi-cell configuration. In this type of learning, the variable states are controlled by the use of fuzzy sets, which allows multiple searches to be performed in one setup, thus reducing the cost of search, compared with conventional Q-learning. In the proposed beam control method, antenna parameters are controlled by fuzzy Q-learning so that the number of users having a received signal power larger than a predetermined threshold becomes larger in each cell. We evaluate the proposed method by computer simulation and show that the proposed method can improve the number of users having a received signal power larger than a predefined threshold and thus reduce the number of users with low throughput compared to before learning.