Search results
1054 packages found
Templates for the crawlee projects
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
Unofficial API lib for Nintendo Switch eShop game listing and pricing information.
Generic node service to handle SSR for SPA made with any kind of frontend framework
Crawlyx is an open-source command-line interface (CLI) based web crawler built using Node.js. It is designed to crawl websites and extract useful information like links, images, and text. It is lightweight, fast, and easy to use.
- web crawler
- web scraping
- data extraction
- SEO analysis
- command-line tool
- Node.js
- HTML reporting
- cross-platform
- configurable options
- plugin system
- open-source
- crawling
- crawler
- scraper
Headless Chrome abstraction to simplify the interaction with the browser. It may be used for crawling sites, test automation, etc
- headless
- chrome
- chromium
- headless-browser
- phantom-js
- nightmare
- casper
- horseman
- crawler
- test-automation
- browser
- node
A web crawler module designed to scarp data from Ptt.
Fast asynchronous NodeJS module for crawling/scraping a web through worker_threads.
novel downloader for node-novel style , include site ( dmzj / wenku8 / syosetu / ...etc )
Shared functionality for implementing device detection engine for the 51Degrees Pipeline API
- 51degrees
- device detection
- user-agent
- client hints
- browser
- os
- device
- cpu
- mobile
- phone
- tablet
- tv
- bot
- crawler
- View more
crawler for single page applications
x-ray's crawler
Bright CLI is a CLI tool that can initialize, stop, polling and maintain scans in Bright solutions.
Device detection on-premise services for the 51Degrees Pipeline API
- 51degrees
- device detection
- user-agent
- client hints
- browser
- os
- device
- cpu
- mobile
- phone
- tablet
- tv
- bot
- crawler
- View more
Device detection cloud services for the 51Degrees Pipeline API
- 51degrees
- device detection
- user-agent
- client hints
- browser
- os
- device
- cpu
- mobile
- phone
- tablet
- tv
- bot
- crawler
- View more
A tool to get information about the contests on each OJ
A robust web scraping library using Playwright for Node.js. This library provides an easy-to-use API for automating web interactions, extracting data, and handling various web scraping tasks efficiently.
A web crawler module designed to scarp data from Bahamut forum.