ull-crawler

Crawler para sacar informacion del campus virtual (moodle) de la Universidad de La Laguna

Install

npm i -g ull-crawler

Usage

cvull <command>
 
# If you want more details on the commands availables run: 
 
cvull --help
 
# Or 
 
cvull <command> --help

Configuration File

This program creates a JSON configuration file that allows it to save the classrooms you want to scrape. As so, the configuration file has this structure:

{
    "username": "<username>",
    "classroomA": "<url>",
    "classroomB": "<url>",
    ...
}

This file is saved in the Home folder at: .cvull/config.json

There is no need for writing this file manually, use the config command.

Important

You've to have configure at least the user for been available to run the commands.

Troubleshooting

Puppeteer Global Install Error:

You need to have write permissions on '/usr/local/lib/', if you don't have it, You will need to set a prefix to npm and add it to PATH variable in your shell (example in ZSH or BASH):

mkdir ~/.npm # If you haven't already have that folder 
 
npm config set prefix ~/.npm
 
# Then go to your shell config file, in this case ~/.bashrc 
# And add $HOME/.npm/bin to your PATH variable 
 
export PATH=$PATH:$HOME/.npm/bin
 
# Changes don't autoreload, if you want to load this changes run: 
 
source ~/.bashrc

Credits

• Puppeteer Global Install Troubleshooting

License

MIT