11 packages found

A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.

published 2.0.3 a year ago
M
Q
P

Parser for robots.txt

published 0.10.1 6 years ago
M
Q
P

A webpack plugin to output a robots.txt file

published 8.0.0 9 months ago
M
Q
P

Awesome generator robots.txt

published 8.0.3 3 years ago
M
Q
P

Generate a robots.txt for Astro

published 0.5.0 a month ago
M
Q
P

React Robots.txt file Generator

published 1.0.7 2 years ago
M
Q
P

RFC 5234 spec compliant robots.txt builder and parser. 🦾

published 2.0.0 3 years ago
M
Q
P

Promise based parser for robots.txt files.

published 3.2.0 3 years ago
M
Q
P

A simple, RFC-compliant robots.txt parser

published 0.1.1 a year ago
M
Q
P

Basic robots.txt generator plugin for Hexo

published 0.2.0 8 years ago
M
Q
P

Basic robots.txt generator plugin for Hexo with Host options

published 0.2.1 6 years ago
M
Q
P