simplewebspider-nodejs
Description
Implementation of a simple web spider crawling the net never ending.
Configuration
You can configure some behavior by setting environment variables or using the file .env
.
The possible configuration is available in config.ts.
Available
- https://gitlab.com/Lepardo/simplewebspider-nodejs
- https://yarnpkg.com/package/simplewebspider-nodejs
- https://www.npmjs.com/package/simplewebspider-nodejs
Contributing
See CONTRIBUTING.md