Nietzsche's Preposterous Moustache

    28 packages found

    Parser for XML Sitemaps to be used with Robots.txt and web crawlers

    published 3.2.5 14 days ago
    M
    Q
    P

    Parser for XML Sitemaps to be used with Robots.txt and web crawlers

    published 3.2.9 2 months ago
    M
    Q
    P

    Parser for XML Sitemaps to be used with Robots.txt and web crawlers

    published 3.2.2 6 months ago
    M
    Q
    P

    Lightweight and easy to use crawling solution for websites.

    published 1.1.65 8 months ago
    M
    Q
    P

    Parser for XML Sitemaps to be used with Robots.txt and web crawlers

    published 3.0.2 4 years ago
    M
    Q
    P

    Download README files from GitHub repository links

    published 1.0.5 a year ago
    M
    Q
    P

    Crawls through provided website, checking for 200 response, content load, ssl cert errors, and more!

    published 1.1.8 2 years ago
    M
    Q
    P

    Web Crawler to create directed graph of links among connected sites. Runs with Node.js and stores data with Redis

    published 1.0.0 a year ago
    M
    Q
    P

    Scrape from any URL for data.

    published 2.3.3 a month ago
    M
    Q
    P

    Parser for XML Sitemaps to be used with Robots.txt and web crawlers. (Extended version by mastixmc)

    published 3.2.0 3 years ago
    M
    Q
    P

    Parser for XML Sitemaps to be used with Robots.txt and web crawlers

    published 2.1.19 a year ago
    M
    Q
    P

    Webcrawler script to retrieve the daily menu of the Bern University of Applied Sciences cantina in Biel

    published 1.0.3 3 years ago
    M
    Q
    P

    Search musics on youtube and return your links

    published 3.0.7 a year ago
    M
    Q
    P

    Parser for XML Sitemaps to be used with Robots.txt and web crawlers

    published 2.1.17 2 years ago
    M
    Q
    P

    A sitemapping tool for crawlers

    published 0.3.1 6 years ago
    M
    Q
    P

    Site mapper utilizing puppeteer to generate a xml sitemap

    published 1.0.5 2 years ago
    M
    Q
    P

    Url scraper which takes the text input and finds the links/urls, scraps them using cheerio and will returns an object with original text, parsed text (using npm-text-parser) and array of objects where each object contains scraped webpage's information.

    published 1.0.2 6 years ago
    M
    Q
    P

    Yet to describe

    published 0.0.0 3 months ago
    M
    Q
    P

    A simple agent for performing a sequence of http requests in node.js

    published 0.1.2 11 years ago
    M
    Q
    P

    MyReadingManga WebCrawler. Find By Languages, Genres and Tags.

    published 0.0.10 3 years ago
    M
    Q
    P