Search results
9 packages found
Sort by: Default
- Default
- Most downloaded this week
- Most downloaded this month
- Most dependents
- Recently published
An extremely lightweight HTTP request client for the command-line. Supports: http, https, proxy, redirects, cookies, content-encoding, multipart/form-data, multi-threading, recursive website crawling and mirroring.
- nget
- request
- http request client
- http client
- http
- https
- client
- proxy
- socks
- socks4
- socks5
- redirect
- redirects
- cookie jar
- View more
published version 4.0.19, 2 years ago1 dependents licensed under $GPL-2.0
162
Highly scalable crawler with best features.
published version 2.0.2, 9 years ago0 dependents licensed under $ISC
54
The simple and fast crawling framework. So you can focus on scraping.
published version 0.4.1, 5 years ago1 dependents licensed under $ISC
32
Easy To Use Web Crawler
published version 1.4.1, 6 years ago0 dependents licensed under $ISC
31
Command Line Interface for Turbo Crawl
published version 0.3.3, 5 years ago0 dependents licensed under $ISC
27
Robust web spider for Node.js
- crawler
- spider
- data miner
- miner
- scraper
- web scraper
- web crawler
- web spider
- web data miner
- web data scraper
- web data crawler
- web data spider
published version 1.0.7, 2 years ago1 dependents licensed under $ISC
21
Open Source Web Crawler
published version 0.3.0, 8 years ago0 dependents licensed under $MIT
9
A full-fledged node.js web crawler with a MySQL backend
- node cli crawler
- node cli scraper
- node low memory crawler
- web spider
- spider
- crawler
- web crawler
- scraper
- scraping
- data mining
- MySQL
- es6
published version 1.1.1, 7 years ago0 dependents licensed under $ISC
8
web crawler
published version 0.0.2, 11 years ago0 dependents licensed under $MIT
5