Search results

52 packages found

Fast duplicate file detection library

published version 0.1.0, 8 years ago2 dependents licensed under $BSD-3-Clause
17

Fast multi-threaded content-dependent chunking deduplication for Buffers in C++ with a reference implementation in Javascript. Ships with extensive tests, a fuzz test and a benchmark.

published version 2.0.4, 6 years ago0 dependents licensed under $MIT
13

Deduplicates and compresses a collection of website files and the resulting files must be interpreted with PHP.

published version 3.6.14, 6 years ago0 dependents licensed under $ISC
10

Copy elements to a new generic array after removing consecutive duplicated values.

published version 0.2.2, 8 months ago1 dependents licensed under $Apache-2.0
11

Astrohelm file system watcher

published version 2.1.0, 8 months ago0 dependents licensed under $MIT
10

Find and manage duplicate files

published version 0.0.9, 3 months ago0 dependents licensed under $MIT
10

Use array methods to process tree-structured data

published version 3.0.16, 7 months ago0 dependents licensed under $Apache
9

Checks the similarity of 2 marc records using neural network.

published version 1.0.1, 10 years ago0 dependents licensed under $ISC
9

Variable sized rolling chunks. Good for deduplication.

published version 0.2.0, 9 years ago0 dependents licensed under $ISC
8

Provided methods allow you to deduplicate messages and get as close to only once message delivery for Google Pub/Sub, long running jobs, etc.

published version 1.0.0, 6 years ago0 dependents licensed under $MIT
6

modified LZ78 compression algorithm. Can be used as a good teaching example

published version 1.0.2, 7 years ago0 dependents licensed under $MIT
6

Remove consecutive duplicated values.

published version 0.2.2, 8 months ago1 dependents licensed under $Apache-2.0
6

node native bindings to a C rabin fingerprinting algorithm

published version 1.5.7, 8 years ago0 dependents licensed under $ISC
6

Deduplicate bookmarks in Chrome exported HTML files.

published version 1.0.0, 9 years ago0 dependents licensed under $ISC
5

To deduplicate multiple consecutive slashes in a path

published version 1.0.1, 5 years ago2 dependents licensed under $ISC
4

command line lead deduplication in js

published version 1.0.0, 8 years ago0 dependents licensed under $MIT
4

command line lead deduplication in js

published version 1.0.5, 8 years ago0 dependents licensed under $MIT
3

A package that provides helper methods for common and not-so-common use cases

published version 1.0.2, 2 years ago0 dependents
2

数组内部值的去重.Study from seriousManual/dedupe

published version 1.0.0, 7 years ago0 dependents licensed under $MIT
2

A node module that removes duplicate lines from one or more files.

published version 1.0.1, 9 years ago0 dependents licensed under $MIT
2