Natural Preference for Minification

252 packages found

M
Q
P

Description

Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously

Keywords

Publisher

published 1.2.02 days ago
M
Q
P

Description

A tiny node module to detect spiders/crawlers quickly and comes with optional middleware for ExpressJS

Keywords

Publisher

published 1.0.1810 months ago
M
Q
P

Description

Unofficial API for zhihu (https://www.zhihu.com)

Keywords

Publisher

published 2.4.3a year ago
M
Q
P

Description

Node.js module for crawling the web

Keywords

Publisher

published 1.0.52 years ago
M
Q
P

Description

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

Keywords

Publisher

published 1.1.610 months ago
M
Q
P

Description

har download 从 chrome 生成的 har 文件中下载整个网站所有资源

Keywords

Publisher

published 1.0.42 years ago
M
Q
P

Description

ECMAScript parser that produces a Shift format AST

Keywords

Publisher

published 5.2.44 months ago
M
Q
P

Description

Parses the wget spider output into an object

Keywords

Publisher

published 2.0.03 years ago
M
Q
P

Description

A simple yet powerful web crawler/spider for Node.js

Keywords

Publisher

published 1.4.14 months ago
M
Q
P

Description

极简网络蜘蛛爬虫,适用任何网站,只需设置一条规则,就可以把你想要网站上的内容整理出来,非常方便,简单!

Keywords

Publisher

published 5.0.14 months ago
M
Q
P

Description

A robots.txt reader, parser and matcher.

Keywords

Publisher

published 1.0.162 years ago
M
Q
P

Description

Crawler (spider) of site web pages by domain name

Keywords

Publisher

published 1.0.515 days ago
M
Q
P

Description

Fetch website with all the resources/responses/requests to local files, using puppeteer.

Keywords

Publisher

published 1.7.22 months ago
M
Q
P

Description

Cylon module for RollingSpider

Keywords

Publisher

published 1.2.22 years ago
M
Q
P

Description

mini spider.

Keywords

Publisher

published 1.0.03 years ago
M
Q
P

Description

web crawler, parser and scraper with storage capabilities

Keywords

Publisher

published 0.3.8a month ago
M
Q
P

Description

a node spider frameword

Keywords

Publisher

published 1.0.87 months ago
M
Q
P

Description

Get a list of local URL links from a root URL.

Keywords

Publisher

published 1.0.36 months ago
M
Q
P

Description

Am I bot or not?

Keywords

Publisher

published 1.0.05 months ago
M
Q
P

Description

convert ASTs between Shift and SpiderMonkey formats

Keywords

Publisher

published 2.0.12 years ago