Search results

12 packages found

Awesome generator robots.txt

published version 8.0.3, 5 years ago15 dependents licensed under $MIT
432,864

A webpack plugin to output a robots.txt file

published version 8.0.0, 3 years ago4 dependents licensed under $MIT
61,564

Generate a robots.txt for Astro

published version 1.0.0, 2 years ago4 dependents licensed under $MIT
53,454

A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.

published version 2.0.3, 3 years ago5 dependents licensed under $MIT
6,307

Parser for robots.txt

published version 0.10.1, 8 years ago18 dependents
723

Basic robots.txt generator plugin for Hexo

published version 0.2.0, 10 years ago0 dependents
578

A lightweight, Open Source robots.txt parser written in JavaScript

published version 1.0.10, 7 days ago0 dependents licensed under $BSD-3-Clause
264

RFC 9309 spec compliant robots.txt builder and parser. 🦾

published version 4.1.0, 7 months ago0 dependents licensed under $MIT
204

Promise based parser for robots.txt files.

published version 3.2.0, 5 years ago0 dependents licensed under $MIT
108

React Robots.txt file Generator

published version 1.0.7, 4 years ago0 dependents licensed under $MIT
31

A simple, RFC-compliant robots.txt parser

published version 0.2.0, 2 years ago1 dependents licensed under $MIT
17

Basic robots.txt generator plugin for Hexo with Host options

published version 0.2.1, 8 years ago0 dependents
5