hexo-generator-robotstxt
A very simple plugin to generate a robots.txt file automatically for Hexo 3.
Usage
Install
npm install hexo-generator-robotstxt --save
Enable
Add hexo-generator-robotstxt to plugins in _config.yml.
plugins:- hexo-generator-robotstxt
Add config for robots.txt to _config.yml.
robotstxt:useragent: "*"disallow:- /one_file_to_disallow.html- /2nd_file_to_disallow.html- /3rd_file_to_disallow.htmlallow:- /one_file_to_allow.html- /2nd_file_to_allow.html- /3rd_file_to_allow.htmlsitemap: /sitemap.xml
Settings & their defaults values
| Setting | Description | Default |
|---|---|---|
| useragent | Set the User-Agent | * |
| disallow | Disallow files or folders for this User-Agent | |
| allow | Allow files or folders for this User-Agent | |
| sitemap | Set the path to your sitemap |