An Automation Benchmark Framework for System Performance Evaluation and Tuning

As the system under test becomes increasingly complex and application scenarios develop rapidly, it is necessary to use a variety of benchmarks and multiple system configurations to comprehensively evaluate a system and tune the system. For improving the efficiency of test, this article proposes an automation test framework. This framework integrates multiple benchmarks and a monitor. The test tasks can be orchestrated by this framework. And these test tasks will be executed automatically and the test data will be profiled. The test data and monitor data provide comprehensive analysis for system performance evaluation and tuning. We implemented and verified the function of the framework.