node package manager
Easy sharing. Manage teams and permissions with one click. Create a free org ยป



Pass in the location of your robots.txt file on the file system, and this module will return you a piece of Connect/Express middleware that will serve it at GET /robots.txt.

This makes one synchronous call to read the file upon start up, then reads it from memory for every request. If you gave the wrong path, you will know about it at startup. Cache headers are set for you.


npm install --save robots.txt


var robots = require('robots.txt')

// Pass in the absolute path to your robots.txt file
app.use(robots(__dirname + '/robots.txt'))


Built by Tom Gallacher and Ben Gourley


Licensed under the New BSD License