❤
npm
Sign UpSign In

Search results

32 packages found

Sort by: Default
  • Default
  • Most downloaded this week
  • Most downloaded this month
  • Most dependents
  • Recently published

sitemapper

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

seantomburke
published version 3.2.20, a month ago62 dependents licensed under $MIT
90,799

http-agent

A simple agent for performing a sequence of http requests in node.js

published version 0.1.2, 14 years ago13 dependents
2,714

sitemapper_mos

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

zijua
published version 3.2.9, 3 years ago0 dependents licensed under $MIT
266

webcrawlerapi-js

JS client for WecrawlerAPI

niiotyo
published version 1.0.7, 4 days ago0 dependents licensed under $MIT
177

@qbbsh/sitemapper

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

qbb.sh
published version 3.2.10, 8 months ago1 dependents licensed under $MIT
131

scrapefrom

Scrape data from any webpage.

nameer
published version 2.6.3, 3 months ago1 dependents licensed under $ISC
116

schabbi-webscraper

Lightweight and easy to use crawling solution for websites.

patrickschababerle
published version 1.2.2, 5 months ago0 dependents licensed under $Apache-2.0
74

fetchyt

Search musics on youtube and return your links

luizdavi
published version 3.0.7, 3 years ago0 dependents licensed under $ISC
46

hellobot

A friendly javascript pre-rendering engine - BETA (UNSTABLE)

siharps
published version 1.2.3, 7 years ago0 dependents licensed under $MIT
44

web-accessibility-crawler

A web accessibility testing crawler using Puppeteer and Axe.

machadluis
published version 1.1.1, 2 months ago0 dependents licensed under $MIT
39

zoinks

Crawls through provided website, checking for 200 response, content load, ssl cert errors, and more!

tsibiski
published version 1.1.8, 4 years ago0 dependents licensed under $GPL-3.0
35

crawl-cli

A Node crawler/scrape for retrieving data from websites

felipextrindade
published version 0.2.0, 8 years ago0 dependents licensed under $ISC
18

@jarronb/site-mapper

Site mapper utilizing puppeteer to generate a xml sitemap

nearaj
published version 1.0.5, 4 years ago0 dependents licensed under $MIT
20

@mastixmc/sitemapper

Parser for XML Sitemaps to be used with Robots.txt and web crawlers. (Extended version by mastixmc)

mastixmc
published version 3.2.0, 6 years ago0 dependents licensed under $MIT
16

@yeskiy/sitemapper

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

yeskiy
published version 5.0.0, 7 months ago0 dependents licensed under $MIT
20

wwweb

An autonomous webcrawler for indexing robots.txt files.

addpixel
published version 1.0.3, 9 years ago0 dependents licensed under $MIT
18

myreadingmanga-unofficial

MyReadingManga WebCrawler. Find By Languages, Genres and Tags.

danrleydfl
published version 0.0.10, 6 years ago0 dependents licensed under $MIT
19

bfh-mensa

Webcrawler script to retrieve the daily menu of the Bern University of Applied Sciences cantina in Biel

hessg1
published version 1.0.3, 5 years ago0 dependents licensed under $MIT
18

@cabbiepete/sitemapper

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

cabbiepete
published version 3.0.2, 6 years ago0 dependents licensed under $MIT
15

@drorgl/sitemapper

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

drorgl
published version 2.1.17, 5 years ago0 dependents licensed under $MIT
13