Simple and powerful crawler. It scraps content and collects links from websites using request or phantomjs. The whole magic and simplicity is behind configuration.
published 1.0.1 9 years agoExtract emails, prices, numbers, geo locations from texts by regular expressions
published 1.0.2 7 years agoDetect type of variable - string, integer, array, geolocation, float, repeatable_string etc
published 0.1.3 8 years agoAdd data in bulk to ItemsAPI or Elasticsearch. It supports data streaming from PostgreSQL or filesystem
published 1.0.28 4 years agoSimple microservice which is responsible for detecting technologies for a given url
published 1.0.0 7 years ago