Approaches and Quality of Algorithm Evaluation

It is a valuable research task to construct the knowledge body and develop the method of analyzing the quality of an algorithm evaluation process since the invention of algorithms is one of the most important research tasks in information technology. To this end, this paper explores approaches and quality of algorithm evaluation through reviewing the papers involved in new approach of algorithm evaluation. Concretely, it does the following three jobs. First, it identifies four approaches of algorithm evaluation and further explores their features. Second, it builds the brief taxonomy of algorithm evaluation from the literature. Third, it proposes a scheme of analyzing the quality of a performance evaluation process. This study aims to facilitate the algorithm inventors to use the proper and high quality way to evaluate algorithms.