grabbi
TypeScript icon, indicating that this package has built-in type declarations

0.1.4 • Public • Published

grabbi Build Status

 simple web scraper/crawler

grabbi using JSDOM and axios under hood provide simple but powerful way for scraping websites.

Install grabbi

npm i grabbi

Usage

const grabbi = require('grabbi')

grabbi('https://www.github.com').then(({ doc, res }) => {
  console.log(doc.title)
  console.log(doc.getElementsByClassName('alt-lead mb-4')[0].textContent)
}).catch(err => console.log(err))

Custom config

const grabbi = require('grabbi')

// you can use https://github.com/axios/axios#axios-api as config
const config = {
  method: 'get',
  timeout: 10000,
  headers: { 'X-Custom-Header': 'foobar' }
}

grabbi('https://en.wikipedia.org/wiki/Main_Page', config).then(({ doc, res }) => {
  console.log(doc.title)
  console.log(doc.querySelector('div[id="articlecount"]').textContent)
}).catch(err => console.log(err))

Package Sidebar

Install

npm i grabbi

Weekly Downloads

0

Version

0.1.4

License

MIT

Unpacked Size

4.22 kB

Total Files

8

Last publish

Collaborators

  • xdk78