simplewebspider-nodejs
Description
Implementation of a simple web spider crawling the net never ending.
Configuration
You can configure some behavior by setting environment variables or using the file .env.
The possible configuration is available in config.ts.
Available
- https://gitlab.com/Lepardo/simplewebspider-nodejs
- https://yarnpkg.com/package/simplewebspider-nodejs
- https://www.npmjs.com/package/simplewebspider-nodejs
Contributing
See CONTRIBUTING.md