This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
published version 1.15.0, 12 days ago
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.