Search results

25 packages found

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 3.2.10 a year ago
M
Q
P

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 3.2.10 a month ago
M
Q
P

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 1.1.5 5 months ago
M
Q
P

A module to parse urls from a local or remote sitemap.xml

published 2.1.0 a month ago
M
Q
P

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 5.0.0 11 days ago
M
Q
P

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 3.2.5 2 years ago
M
Q
P

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 3.2.9 3 days ago
M
Q
P

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 3.2.9 2 years ago
M
Q
P

Powerful yet simple sitemap parser.

published 1.0.1 2 years ago
M
Q
P

It parses xml based on sitemap.xml and gets all files described in sitemap. Supports gz format

published 0.0.4 2 years ago
M
Q
P

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 3.0.2 6 years ago
M
Q
P

An RFC-3986 compliant and zero-dependencies Node.js module to parse URIs, punycode, punydecode, test URIs, URLs, Sitemap URLS, domains, IPs but also encode and decode URIs, URLs and Sitemap URLs

published 1.1.2 a year ago
M
Q
P

A node-html-parser based sitemap generator

published 1.1.5 a day ago
M
Q
P

Parser for XML Sitemaps to be used with Robots.txt and web crawlers. (Extended version by mastixmc)

published 3.2.0 5 years ago
M
Q
P

A module to parse rss and sitemap and give you the links or contents in JSON or HTML format.

published 1.0.0 8 years ago
M
Q
P

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 3.2.8 a year ago
M
Q
P
M
Q
P

Promise based parser for robots.txt files.

published 3.2.0 4 years ago
M
Q
P

Get a list of URLs from one or more sitemaps

published 1.7.0 5 years ago
M
Q
P

It parses xml based on sitemap.xml and gets all files described in sitemap. Supports gz format

published 0.0.2 5 years ago
M
Q
P