scrapm

0.2.1 • Public • Published

scrapm

more convenient scraper for node.js

Usage

var scrapm = require('scrapm');

scrapm([options], callback);

options are request options:

  • url - (required) target url you want to scrape
  • blocked - default false, true if the server is blocking scraping by machine. it cheats the server by changhing 'User-Agent' in header.
  • encoding - default false, true if the encoding of the webpage is not utf-8.
  • sourceEncoding - default '', encoding of the webpage if options.encoding is true
  • targetEncoding - default '', encoding you want to get if options.encoding is true

callback is called with (err, $). You can manipulate DOM with $ as you want. $ is implemented with jsdom.

Dependencies

  • iconv
  • jsdom
  • request

License

MIT License

Package Sidebar

Install

npm i scrapm

Weekly Downloads

6

Version

0.2.1

License

MIT

Last publish

Collaborators

  • thechunsik