kerouac-robotstxt0.4.2 • Public • Published
Kerouac is open source software. Ongoing development is made possible by generous contributions from individuals and corporations. To learn more about how you can help keep this project financially sustainable, please visit Jared Hanson's page on Patreon.
$ npm install kerouac-robotstxt
Simply declare a
robots.txt page, using this middleware.
The generated output will include a
/robots.txt resource. If your site
contains any sitemaps, which can be generated using kerouac-sitemap,
the sitemap locations will be included so that search engines will automatically
discover all pages of your site.
Copyright (c) 2012-2018 Jared Hanson <http://jaredhanson.net/>