An Efficient Energy Consumption Prediction Framework for High Performance Computing Cluster Jobs

Energy consumption prediction is a crucial approach to enhance the operational efficiency of HPC (High Performance Computing) clusters. Existing predicting methods for the energy consumption mainly rely on time series mode, focusing on the instantaneous power during job execution. However, in practical applications, due to the large scale of HPC clusters, the prediction models need to process a vast amount of data, often resulting in poor performance. Moreover, it's challenging to provide effective predictions for jobs with significant power fluctuations. Thus we propose a more efficient energy consumption prediction framework for HPC cluster jobs, achieving two main objectives: On one hand, it uses a data encoding module to pre-encode the sampled data of energy consumption related indicators, simplifying the data that the time series prediction model needs to process and improving prediction efficiency. On the other hand, the prediction target is set to the power distribution range in a future period of time, rather than the instantaneous power at some specific time points, which improves the usability of the prediction results. Test results show that the proposed prediction framework can achieve more markable performance improvement while ensuring the effectiveness of the predictions.