169 packages found

M
Q
P

Description

fs.readdir with sync, async, streaming, and async iterator APIs + filtering, recursion, absolute paths, etc.

Keywords

Publisher

published 6.0.32 months ago
M
Q
P

Description

Generic utility functions (Mixin Lodash)

Keywords

Publisher

published 1.1.172 months ago
M
Q
P

Description

a crawler cli of comics

Keywords

Publisher

published 1.1.22 months ago
M
Q
P

Description

Crawl data or download files from website with custom rules

Keywords

Publisher

published 1.0.26 months ago
M
Q
P

Description

node.js web crawler

Keywords

Publisher

published 2.0.19 months ago
M
Q
P

Description

A lightweight crawler framework with your custom focus. 一个轻量级的可自定义重点的爬虫框架

Keywords

Publisher

published 1.2.12 years ago
M
Q
P

Description

gsping ====================

Keywords

Publisher

published 1.1.55 months ago
M
Q
P

Description

爬虫工具,根据传入的配置和规则爬取数据

Keywords

Publisher

published 1.1.4-09 days ago
M
Q
P

Description

Thief CLI =========

Keywords

Publisher

published 1.1.1a year ago
M
Q
P

Description

HTTP library specifically designed for crawling the web. Built-in caching and per-domain queueing

Keywords

Publisher

published 0.7.76 months ago
M
Q
P

Description

Downloader of popular images for the image board

Keywords

Publisher

published 1.0.105 months ago
M
Q
P

Description

Recursive directory reader with a delightful API

Keywords

Publisher

published 8.1.17 days ago
M
Q
P

Description

Node.js module that recursively crawls a website's sitemap and returns a stream of URLs

Keywords

Publisher

published 0.11.05 months ago
M
Q
P

Description

Asynchronous options for crawling file system

Keywords

Publisher

published 0.0.310 months ago
M
Q
P

Description

fs.readdir with sync, async, streaming, and async iterator APIs + filtering, recursion, absolute paths, etc.

Keywords

Publisher

published 6.0.32 months ago
M
Q
P

Description

Utils for web resources. Get a web page and save to disk (with minimal dependencies)

Keywords

Publisher

published 1.0.09 months ago
M
Q
P

Description

Crawling Udemy course info and save into JSON format.

Keywords

Publisher

published 1.1.12 years ago
M
Q
P

Description

SeoCheck module is build to check if there is/are any irregularites in your HTML file. You can customise your own set of rules to check if your end requirements are met.

Keywords

Publisher

published 1.0.22 years ago
M
Q
P

Description

a minimal puppeteer crawler api

Keywords

Publisher

published 0.2.02 years ago
M
Q
P

Description

OAI-PMH harvester module for nodejs

Keywords

Publisher

published 2.1.2a month ago