Search results

67 packages found

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 3.2.9 a month ago
M
Q
P

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 3.2.10 2 months ago
M
Q
P

A selector-based html snapshot tool using Puppeteer or PhantomJS that sources sitemap.xml, robots.txt, or arbitrary input

published 3.13.1 5 days ago
M
Q
P

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 3.2.10 a year ago
M
Q
P

A specification compliant robots.txt parser with wildcard (*) matching support.

published 3.0.1 a year ago
M
Q
P

Sitemap generator for TypeScript projects

published 1.7.3 2 months ago
M
Q
P

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

published 5.0.0 a month ago
M
Q
P

Generate a robots.txt for Astro

published 1.0.0 a year ago
M
Q
P

The grunt task for html-snapshots

published 7.13.1 3 days ago
M
Q
P

A TypeScript-based project for easy serving of static files with support for live reloading, compression, and typed requests.

published 3.0.50 2 months ago
M
Q
P

Vite plugin for generating robots.txt for production and development builds

published 1.0.5 4 months ago
M
Q
P

Parser for robots.txt

published 1.0.0 4 months ago
M
Q
P

Express middleware for generating your robots.txt

published 1.0.0 5 years ago
M
Q
P
M
Q
P

An Eleventy plugin to generate a robots.txt file for your static site

published 0.0.4 3 months ago
M
Q
P

robots.txt middleware for Kerouac.

published 0.7.0 4 months ago
M
Q
P

Awesome generator robots.txt

published 8.0.3 4 years ago
M
Q
P

A webpack plugin to output a robots.txt file

published 8.0.0 2 years ago
M
Q
P

Generate a robots.txt file for your Astro site

published 0.1.2 2 months ago
M
Q
P

Express middleware to serve and generate robots.txt

published 1.0.0 3 years ago
M
Q
P