ATC: An Automatic Text Comparison Tool Based on Diff Algorithm

Text comparison is to look up the differences and commonness between texts, so it is widely used in editing, duplicate checking, keywords extraction and so on. To improve the efficiency of batch text comparison, we have designed an automatic text comparison tool (ATC) based on Diff algorithm. According to the pipeline design mode, ATC combines multiple processes such as multiple data sources access, file filtering, de-duplication, extraction, comparison, and display, while using multithreading technology to accelerate the text comparison process. The experimental results show that ATC can be applied to multilingual text comparison, and the introduction of multithreading technology has also greatly improved the comparison efficiency.