Nonviolent Pirate Mobster

    crawl_str

    1.0.6 • Public • Published

    intall

    $ npm install crawl_str
    

    usage

    const crawl_str = require('crawl_str');
    crawl_str(`
    Make url list here
    Lines that doesn't start with 'http' or 'https' are gonna be ignored
     
     
    https://archive.is/ALjBy
    https://archive.is/ALjBy
    https://archive.is/ALjBy
    https://archive.is/ALjBy
    https://archive.is/ALjBy
     
     
    `, {
        progress: (info, progress_ratio) => {
            console.log('progress', info.url, progress_ratio);
        },
        complete: faillist => {
            console.log('complete');
        }
    }, './data/');

    Keywords

    none

    Install

    npm i crawl_str

    DownloadsWeekly Downloads

    0

    Version

    1.0.6

    License

    ISC

    Unpacked Size

    16.6 kB

    Total Files

    11

    Last publish

    Collaborators

    • kstost