megafunnel-view

aggregate views on top of megafunnel

Example

add a views section to megafunnel config file, (this query will work with the default condor which is hosted by megafunnel)

{
  "views": {
    "clicks": {
      "count": {
        eventName: 'click',
        href: true
      }
    }
  }
}

Start the megafunnel-view server, it uses the same config file as megafunnel

# start the view server
megafunnel-view

Now, assuming there is some data already in megafunnel, (see the megafunnel documentation get started), request the view over http:

# request data over http!
curl "$HOST:$PORT/query/clicks&period=Minutes"

http api

GET /view/{name}?period={Minutes,Hours,Date,FullYear}

period is the only mandatory option. the value must be a valid time-period

also, a range may be passed. Any valid level range may be passed. I suggest using only lt, gt, lte, gte ranges

The values can be any valid string for new Date(string) including a timestamp (i.e. +new Date())

By default, the response will be valid json, to get line delimited json, use the option &lines=true.

To get a realtime feed, use &tail=true. You can parse streaming json with JSONStream although using line delimited json is more performant.

get /views

return array of names of all querys

GET /state/{name}?period={Minutes,Hours,Date,FullYear}

Get a snapshot of the current state of this query. This returns the current values for the given period, if the period is not provided, values for all periods are returned.

GET /state?period={Minutes,Hours,Date,FullYear}

get a snapshot for all queries, with optional period as with /state/{name}

views/configuration

Currently, views must be entered into the configuration file. After editing the file, restart megafunnel-view for the update to take effect. If you delete the view db (rm -rf ~/.megafunnel/viewdb) then all views will be recreated from scratch (for a large dataset this may take a few minutes)

views are input as json objects into the config file: {"views": {[name]: {[type]:query}}}

some example views

//NOTE, comments for explaination,
//comments are not valid in JSON.
{
  "views": {
    //total clicks, on everything.
    "clicks": {
      "count": {
        "eventName": "click"
      }
    },
    //clicks on page (url)
    "clicks-by-location": {
      "count": {
        "eventName": "click",
        "location": true
      }
    },
    //average time spent on site.
    "duration": {
      "stats": {
        "eventName": "end",
        "duration": true
      }
    },
    //total impressions, on everything
    "load": {
      "count": {
        "eventName": "load"
      }
    },
 
    //load, by referrer domain.
    //this aggregates all links (i.e facebook.com/...) but not their whole url.
    "load-referrer-domain": {
      "count": {
        "eventName": "load",
        "referrer": "/http:\\/\\/([\\w.]+)/"
      }
    },
    //average time to load the page.
    "load-stats": {
      "stats": {
        "eventName": "load",
        "duration": true
      }
    }
  }
}

License

MIT