Neolithic Programming Machine
Learn about our RFC process, Open RFC meetings & more.Join in the discussion! »

aimer

1.2.0 • Public • Published

aimer NPM version NPM downloads Circle CI

Remote web content crawler done right.

Motivation

Sometimes I want to grab some nice images from a url like http://bbs.005.tv/thread-492392-1-1.html, so I made this little program to combine node-fetch and cheerio to make my attempt fulfilled.

Install

$ npm install --save aimer

For Single Page Apps please head to aimer-nightmare

Usage

const aimer = require('aimer')
 
aimer('http://some-url.com/a/b/c')
    .then($ => {
        $('img.nice-images').each(function () {
            const url = $(this).attr('src')
            console.log(url)
        })
    })

API

aimer(url, opts)

opts

cheerio

cheerio options. Except decodeEntities is false by default here.

got

got options, this module is used for retriving web contents.

proxy

An http or https proxy address, eg: http://localhost:8787 for Lantern. If process.env.http_proxy is set and opts.proxy is not set we use the former. Set opts.proxy to false to disable proxy anyway.

License

MIT © EGOIST

Keywords

none

Install

npm i [email protected]

Version

1.2.0

License

MIT

Last publish

Collaborators

  • avatar
  • avatar