Search results

@akilio/site-data

Website schema based crawler

• crawler
• scrapper
• parser

akilio

published 1.0.5 • 3 years agopublished 1.0.5 3 years ago

crawler-cli

A simple command line app for controlling a GitHub Crawler

• GitHub
• API
• crawler

jeffmcaffer

published 0.1.3 • 7 years agopublished 0.1.3 7 years ago

check-site-for

Check sites for a given content

• check
• site
• crawler
• scrapper

boo1ean

published 0.1.0 • 10 years agopublished 0.1.0 10 years ago

github_trending_node

nodejs modules used for fetching github trending data

• nodejs
• crawler
• github
• trending

royxue

published 0.0.1 • 8 years agopublished 0.0.1 8 years ago

reddit-crawler

crawl all submissions in a subreddit

• reddit
• crawler

danneu

published 0.0.1 • 6 years agopublished 0.0.1 6 years ago

goose-paginator

Paginator enriches ability to paginate over the pages in Goose Parser

• paginator
• paginate
• parser
• crawler
• crawling
• spider
• scraper
• scraping
• site
• page
• dom
• javascript

redcode

published 1.0.2 • 6 years agopublished 1.0.2 6 years ago

men-bundle

Express and mongoose module bundles

• crawler
• core

xufeng23

published 1.0.1 • 7 years agopublished 1.0.1 7 years ago

@coya/web-scraper

Web scraper on top of PhantomJS or Chromium

• web
• scraping
• scraper
• crawler
• data
• gathering

coya

published 0.2.2 • 6 years agopublished 0.2.2 6 years ago

pttcrawler

a ptt crawler

• ptt
• crawler

johnny9144

published 0.0.5 • 7 years agopublished 0.0.5 7 years ago

sleepsecure

A lightweight scraper for SleepCycle's online SleepSecure data.

• scraper
• crawler
• client
• health
• sleep
• sleepcycle

elliottcable

published 0.0.2 • 6 years agopublished 0.0.2 6 years ago

crawler4js

crawler for node.js.

• crawler
• crawler4j
• crawler4js
• nodejs
• node
• data
• html
• http

qiu_yongjin

published 0.0.3 • 2 years agopublished 0.0.3 2 years ago

simple-webloader

• spider
• crawler
• grabber
• parser

antixrist

published 0.0.4 • 8 years agopublished 0.0.4 8 years ago

@glossa/fin-insight

A crawler

• crawler
• spider

hoyeung

published 0.2.8 • 3 years agopublished 0.2.8 3 years ago

@glossa/ratio-fin-cn

A crawler

• crawler
• spider

hoyeung

published 0.2.8 • 3 years agopublished 0.2.8 3 years ago

@glossa/index-fin-sse

A crawler

• crawler
• spider

hoyeung

published 0.2.8 • 3 years agopublished 0.2.8 3 years ago

@ljw1412/web-crawler

基于Node.js的网络爬虫

• crawler
• spider
• web-crawler
• node-crawler
• puppeteer
• proxy

ljw1412

published 0.0.25 • 4 years agopublished 0.0.25 4 years ago

bettong

Web crawler in JavaScript

• puppeteer
• javascript
• crawler
• nodejs
• html
• screenshot

alstar01

published 0.2.1 • 4 years agopublished 0.2.1 4 years ago

hcrawler

a hierachical web crawler with concurrency control and server-side jQuery support

• web
• crawler
• hierachical
• multiple
• level
• concurrency
• jQuery

llllkkkk

published 0.0.5 • 11 years agopublished 0.0.5 11 years ago

jasg

Just Another Sitemap Generator

• sitemap
• crawler

angga2oioi

published 0.0.11 • 4 years agopublished 0.0.11 4 years ago

crawl_fetcher

A web crawler. Automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.

• crawler
• spider

wangnn01

published 1.0.0 • 4 years agopublished 1.0.0 4 years ago