Search results
40 packages found
A thin wrapper around fetch that prevents duplicate requests.
Provided methods allow you to deduplicate messages and get as close to only once message delivery for Google Pub/Sub, long running jobs, etc.
node native bindings to a C rabin fingerprinting algorithm
Deduplicates and compresses a collection of website files and the resulting files must be interpreted with PHP.
A package to detect similar Gmail addresses based on Gmail's unique addressing rules.
command line lead deduplication in js
A package that provides helper methods for common and not-so-common use cases
- helper
- helper methods
- deepcopy
- deep copy
- dedupe
- deduplication
- remove duplicates
- async
- indexes
- indexesOf
- trim
- trim delimeters
- trim start
- trim end
A node module that removes duplicate lines from one or more files.
数组内部值的去重.Study from seriousManual/dedupe
Fast multi-threaded content-dependent chunking deduplication for Buffers in C++ with a reference implementation in Javascript. Ships with extensive tests, a fuzz test and a benchmark.
- async
- backup
- bandwidth
- block size
- boundary shift
- cas
- cdc
- content-addressable storage
- content-defined chunking
- content-dependent chunking
- cryptographic hash calculation
- cut-point
- deduplication
- differential compression
- View more
Deduplicates queries that are currently on the wire
Checks the similarity of 2 marc records using neural network.
command line lead deduplication in js
To deduplicate multiple consecutive slashes in a path
Rapid Asymmetric Maximum (RAM) is a high throughput, hash-less, byte shift-resistant content-defined chunking algorithm for data deduplication.
- cdc
- content defined chunking
- content dependent chunking
- rapid asymmetric maximum
- ram
- deduplication
- chunking
- chunker
- algorithm
modified LZ78 compression algorithm. Can be used as a good teaching example
Deduplicate bookmarks in Chrome exported HTML files.
Fast duplicate file detection library
Merges two arrays into one and removes duplicates
Variable sized rolling chunks. Good for deduplication.