9 packages found

M
Q
P

Description

detects bots/crawlers/spiders via the user agent.

Keywords

Publisher

published 2.2.12 months ago
M
Q
P

Description

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

Keywords

Publisher

published 2.2.03 months ago
M
Q
P

Description

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

Keywords

Publisher

published 3.0.24 months ago
M
Q
P

Description

detects bots/crawlers/spiders via the user agent.

Keywords

Publisher

published 2.3.04 months ago
M
Q
P

Description

Parse robot directives within HTML meta and/or HTTP headers.

Keywords

Publisher

published 0.4.02 years ago
M
Q
P

Description

Opensource Framework Crawler in Node.js

Keywords

Publisher

published 2.0.10a month ago
M
Q
P

Description

It uses the user-agents.org xml file for detecting bots.

Keywords

Publisher

published 1.0.104 years ago
M
Q
P

Description

Crawler made simple

Keywords

Publisher

published 0.0.34 years ago
M
Q
P

Description

A jQuery plugin that helps you to hide your email on your page and prevent crawlers to get it!

Keywords

Publisher

published 0.1.03 years ago