11 packages found
A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.
published 2.0.3 a year ago
M
Q
P
M
Q
P
A webpack plugin to output a robots.txt file
published 8.0.0 9 months ago
M
Q
P
Awesome generator robots.txt
published 8.0.3 3 years ago
M
Q
P
Generate a robots.txt for Astro
published 0.5.0 a month ago
M
Q
P
React Robots.txt file Generator
published 1.0.7 2 years ago
M
Q
P
RFC 5234 spec compliant robots.txt builder and parser. 🦾
published 2.0.0 3 years ago
M
Q
P
Promise based parser for robots.txt files.
published 3.2.0 3 years ago
M
Q
P
A simple, RFC-compliant robots.txt parser
published 0.1.1 a year ago
M
Q
P
Basic robots.txt generator plugin for Hexo
published 0.2.0 8 years ago
M
Q
P
Basic robots.txt generator plugin for Hexo with Host options
published 0.2.1 6 years ago
M
Q
P