201 packages found

    爬虫工具,根据传入的配置和规则爬取数据

    published 1.1.4-0 2 years ago
    M
    Q
    P

    HTTP library specifically designed for crawling the web. Built-in caching and per-domain queueing

    published 0.7.7 3 years ago
    M
    Q
    P

    A mirroring plugin for webcheck

    published 1.0.0 4 years ago
    M
    Q
    P

    Scrap and collect data from urls, html, json and stuff..

    published 0.5.3 8 years ago
    M
    Q
    P

    Simple scraper for imitating browsing sessions

    published 0.0.2 8 years ago
    M
    Q
    P

    一个简单的图片爬取模块,可以批量搜索本地文件中的图片链接并下载,基于nodejs

    published 1.0.0 4 years ago
    M
    Q
    P

    A module to download images from a given URL

    published 0.0.2 9 years ago
    M
    Q
    P

    Perfect SEO for JavaScript websites. Pre-rendering — it's just like SSR with simple integration and no coding

    published 1.6.6 2 months ago
    M
    Q
    P

    Website extensions for the Sajari API. Automatically index site content, add user profiles, render search and recommendations, etc.

    published 0.11.0 4 years ago
    M
    Q
    P

    Web Crawler

    published 1.0.0 5 years ago
    M
    Q
    P

    Quickly crawl the information (e.g. followers, tags, etc...) of an instagram profile. No login required!

    published 2.0.2 4 years ago
    M
    Q
    P

    Node.js module that recursively crawls a website's sitemap and returns a stream of URLs

    published 0.11.0 3 years ago
    M
    Q
    P

    Web Crawler

    published 1.0.0 5 years ago
    M
    Q
    P

    Recursive directory reader with a delightful API

    published 8.2.2 a year ago
    M
    Q
    P

    A node.js module to crawl product IDs from Amazon.

    published 0.0.9 9 years ago
    M
    Q
    P

    node.js web crawler

    published 2.0.1 3 years ago
    M
    Q
    P

    mrspider middleware to extract data using regular expressions.

    published 1.1.0 6 years ago
    M
    Q
    P

    fs.readdir with sync, async, streaming, and async iterator APIs + filtering, recursion, absolute paths, etc.

    published 6.0.4 2 years ago
    M
    Q
    P

    Scrapoxy is a proxy for scrapers

    published 3.1.1 4 years ago
    M
    Q
    P

    Simple, configurable and extensible webcrawler

    published 0.1.4 8 years ago
    M
    Q
    P