Two-Player Multiagent Graphical Games with Reinforcement Learning*

This paper studies the synchronization problem of two-player multiagent systems through reinforcement learning methods. A Nash-minmax strategy is formulated, where the interactions of two players in the same agent are non-zero-sum, while interactions of players between agents are zero-sum games. We propose an offline model-based reinforcement learning algorithm to identify Nash solutions for players within each agent, as well as the worst control solutions for players in neighboring antagonistic agents. On this basis, a data-driven off-policy algorithm is provided to alleviate the requirement for accurate system dynamics in the offline algorithm. Besides, the convergence of the proposed algorithms is analyzed. Finally, simulation results verify the effectiveness of the designed algorithms.