167 packages found

M
Q
P

Description

fs.readdir with sync, async, streaming, and async iterator APIs + filtering, recursion, absolute paths, etc.

Keywords

Publisher

published 6.0.011 hours ago
M
Q
P

Description

Thief CLI =========

Keywords

Publisher

published 1.1.1a year ago
M
Q
P

Description

Generic utility functions (Mixin Lodash)

Keywords

Publisher

published 1.1.154 months ago
M
Q
P

Description

Downloader of popular images for the image board

Keywords

Publisher

published 1.0.10a month ago
M
Q
P

Description

Utils for web resources. Get a web page and save to disk (with minimal dependencies)

Keywords

Publisher

published 1.0.05 months ago
M
Q
P

Description

Crawl data or download files from website with custom rules

Keywords

Publisher

published 1.0.23 months ago
M
Q
P

Description

node.js web crawler

Keywords

Publisher

published 2.0.16 months ago
M
Q
P

Description

gsping ====================

Keywords

Publisher

published 1.1.52 months ago
M
Q
P

Description

HTTP library specifically designed for crawling the web. Built-in caching and per-domain queueing

Keywords

Publisher

published 0.7.73 months ago
M
Q
P

Description

Node.js module that recursively crawls a website's sitemap and returns a stream of URLs

Keywords

Publisher

published 0.11.02 months ago
M
Q
P

Description

Recursive directory reader with a delightful API

Keywords

Publisher

published 4.0.111 days ago
M
Q
P

Description

Asynchronous options for crawling file system

Keywords

Publisher

published 0.0.37 months ago
M
Q
P

Description

爬虫工具,根据传入的配置和规则爬取数据

Keywords

Publisher

published 1.1.32 months ago
M
Q
P

Description

Crawling Udemy course info and save into JSON format.

Keywords

Publisher

published 1.1.1a year ago
M
Q
P

Description

Collect the descendants of a directory.

Keywords

Publisher

published 2.0.03 months ago
M
Q
P

Description

A Page resource pool for Puppeteer.

Keywords

Publisher

published 1.2.16 months ago
M
Q
P

Description

Scrap the web asynchronously in live, reusing Node.js, all in one file, with a few lines!

Keywords

Publisher

published 1.1.02 years ago
M
Q
P

Description

SeoCheck module is build to check if there is/are any irregularites in your HTML file. You can customise your own set of rules to check if your end requirements are met.

Keywords

Publisher

published 1.0.22 years ago
M
Q
P

Description

Perfect SEO for JavaScript websites. Pre-rendering — it's just like SSR, but with no coding and simple integration

Keywords

Publisher

published 1.4.52 months ago
M
Q
P

Description

a minimal puppeteer crawler api

Keywords

Publisher

published 0.2.02 years ago