@studiowebux/crawler

6.0.0-alpha • Public • Published

Crawler

npm install --save @studiowebux/crawler

Features

  • Open browser, page and navigate to url
  • Collect HAR Data
  • Collect media resources (Audio, Video, Images)
  • Take Screenshot (Fullscreen or not)
  • Extract HTML Elements
  • Extract named Metadata
  • Generate identifier (Using page title and url)
  • Extract html (document.*) and extract innerHtml (body.innerHtml)

Usage

See Example

node __tests__/index.js

Versions

Current Tags

VersionDownloads (Last 7 Days)Tag
6.0.0-alpha0latest

Version History

VersionDownloads (Last 7 Days)Published
6.0.0-alpha0
5.0.00
4.25.10

Package Sidebar

Install

npm i @studiowebux/crawler

Weekly Downloads

0

Version

6.0.0-alpha

License

MIT

Unpacked Size

14 kB

Total Files

14

Last publish

Collaborators

  • tgingras