Easily scrape websites for html header meta data
A simple easy to use HTML head scraper that provides a clean interface for extracting data from the tags within the
The usage is simple and familiar. Just provide a url and callback function and it will be supplied with an accessor object that you can use to extract head tags.
var scraper = require'orgasmatron';scraper''bundlefindWhere'meta' name: 'description';;
The above looks for the first meta tag that has an attribute called name set to the value 'description'. In this case you would get back the object:
content: 'Search the world\'s information, including webpages, images, videos and more. Google has many special features to help you find exactly what you\'re looking for.'name: 'description'
npm install orgasmatron
- Easy to learn
- Leaves head tags in their original form
- Flexibly allows you to extract data
The require call returns a function that expects a url string and a callback function.
The callback function takes two parameters,
(err, bundle) where bundle is an accessor object for finding head tags.
The data bundle provides methods for accessing data.
Returns a list of all element objects that have the same tag string as the argument
tag, and matches the attributes object. The attributes object defines attribute keys that must exist, as well as the values that must match them. If an attribute key is provided but the value is
undefined, the attribute is checked to exist, but the value may be any value.
Returns the first element object that matches using the same criterion of
If you want to match any meta tag that has the
content attribute set you can call the
.where method with the key defined with no value in the attributes object.
bundlewhere'meta' content: undefined;
That would return all meta tags with a
property: 'og:type' content: 'website'property: 'og:title' content: 'My First Website'property: 'og:description' content: 'This is my first website, I hope you enjoy!'
If you only wanted meta tags with
property set to
og:title, you would provide an attribute object with a key
property set to the string
og:title. Using findWhere would stop looking after finding the first element that matches.
bundlefindWhere'meta' property: 'og:title';
That would only return the first meta tag with a an attribute of
property set to
property: 'og:title' content: 'My First Website'