Periodic Crawler
I do NOT recommend using it in real projects.
npm i periodic-crawler
Exsampls
const periodicCrawler = ; async { const res = await ; console;}; // in console:// [// {// "url": "www.example.com/",// "dowDate": "2019-04-01T02:39:55.268Z",// "body": "<!doctype html>\n<html>\n<head></head>\n\n<body>\n<div>\n <h1>Example Domain</h1>\n <p>This domain is established to be used for illustrative examples in documents. You may use this\n domain in examples without prior coordination or asking for permission.</p>\n <p><a href=\"http://www.iana.org/domains/example\">More information...</a></p>\n</div>\n</body>\n</html>\n"// }// ]
TODO
- Puppeteer option for scrapping