I. Introduction
In order to meet the diversified needs of services and network high-speed requirements, the mobile communication network environment is developing from a single network to multiple networks. The new generation of heterogeneous Macro/Femtocell networks enhances the coverage area of mobile networks and the quality of users, and is thus widely used [1]. However, the spectrum sharing among Macro/Femtocell heterogeneous networks leads to inter-layer or cross-layer interference between networks, resulting in severe resource wastage and increased network energy consumption [2]. Therefore, a reasonable resource allocation scheme is needed for the heterogeneous network energy efficiency problem. The orthogonal frequency division multiple access (OFDMA) technology has become the dominant multi-access technology with its high data rate access system. In the OFDMA system, the traditional wireless resource allocation scheme focuses primarily on enhancing the user transmission rate or reducing the system's energy consumption. However, it does not address the system's energy efficiency.