Clustered Outband Deduplication on Primary Data

Data reduplication is a special technique to recognize the duplicate data, which stores only one copy for all redundant data, and creates a link to that copy so when data is access by the user, one will have to refer that link. Out-band reduplication is done, after the backup has been written. In today's era, data reduplication has become the necessity and critical component for the primary storage. In this paper, we have discussed the technique of Out-band data reduplication on primary storage workloads such as data used in common day-to-day life and user directories. This paper also discusses the implementation of out-band reduplication for primary storage in order to increase the RAM performance, throughput, and efficient lookups in the memory. To improve the lookup performance of the system, we have used cuckoo filter instead of multi-layer traditional filters.