ScrapeMate is available as open source node package to all developers to use in projects.
It can be installed by running the following node command:
npm install ScrapeMate --save
ScrapeMate can be used to scrape different HTML tags and links from any webpage by passing on URL of the target and other optional parameters. It primarily consists of the following functions -
getTags(url) - To get a list of all the tags used in the HTML code of a target webpage located in the passed on URL.
getLinks(url) - Used to obtain all the links placed in the target webpage located in the passed on URL.
getTagItem(url,tag) - Used to obtain all the tags passed on to the function present in the target webpage located in the passed on URL.
Example for getTags(url)
let uri = 'https://google.com';
getTags(uri).then(res => {
var result = res;
console.log(result);
});
Example for getLinks(url)
let uri = 'https://google.com';
getLinks(uri).then(res => {
console.log(res);
console.log(res.length);
});
Example for getTagItem(uri,tag)
let uri = 'https://google.com';
let tag = 'div';
getTagItem(uri, tag).then (res => {
console.log(res);
console.log(res.length);
});