ronomon/deduplication

Fast multi-threaded content-dependent chunking deduplication for Buffers in C++ with a reference implementation in Javascript. Ships with extensive tests, a fuzz test and a benchmark.

2 best points · 0 comments · 2 Hacker News posts · 76 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Fast multi-threaded content-defined chunking deduplication for Node.js (2 points, 0 comments, by _urga, 2017-08-17)
• Data deduplication for Node.js (2 points, 0 comments, by _urga, 2017-08-24)