I. Introduction
In recent years, distributed optimization [1], [2], [3], [4] and noncooperative game [5], [6] on multi-agent networks have received a lot of attention, because of their wide applications in wireless network [7] and machine learning [8].