npm

generate-robotstxt

Description

Awesome generator robots.txt

Keywords

• robotstxt
• robots.txt
• generate
• robots-txt
• user-agent
• police
• allow
• disallow
• crawl-delay
• robot
• robots

Publisher

evilebottnawi

published 6.0.1 • 3 months ago