Search results
25 packages found
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
A module to parse urls from a local or remote sitemap.xml
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
It parses xml based on sitemap.xml and gets all files described in sitemap. Supports gz format
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
An RFC-3986 compliant and zero-dependencies Node.js module to parse URIs, punycode, punydecode, test URIs, URLs, Sitemap URLS, domains, IPs but also encode and decode URIs, URLs and Sitemap URLs
A node-html-parser based sitemap generator
Parser for XML Sitemaps to be used with Robots.txt and web crawlers. (Extended version by mastixmc)
A module to parse rss and sitemap and give you the links or contents in JSON or HTML format.
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
allows you to use rss easily
- rss
- xml
- feed
- feed builder
- rss feed
- parser
- podcasts
- sitemap
- site map
- rss to json
- rss reader
- rss finder
- read rss
- rss parser
- View more
Promise based parser for robots.txt files.
Get a list of URLs from one or more sitemaps
It parses xml based on sitemap.xml and gets all files described in sitemap. Supports gz format