Extract page name/id for a given Facebook URL.
Streaming parser for robots.txt files
Check user agents against robots.txt files
Validate urls against robots.txt rules.
setInterval for scalable applications
Detects and parses user ids out of urls of well known social networks.
Bunyan stream used to format logger input based on a JSON schema.
Verifies session cookies for authentication status.
Fetch requests in HAR format
Woorank Living Style guide
Calculate string pixel width for support to all Unicode characters
Receive any type of sitemap stream and parse it. Stream back list of URLs or errors found
Convenience wrapper around wappalyzer library
DOM traversal tools
Parse jsonld from a HTML document
Parse microformats from a HTML document
Parse structured data from a HTML DOM