HTTP-based side-by-side benchmark framework
HTTP-based side-by-side benchmark framework
benchmarx automates your benchmark running/reporting, and supports
siege, and slam (a pure-node alternative).
Benchmark a server (implement a
listen() method) or a middleware (implement a
middleware method), and easily create side-by-side reports by adding new files
npm install --save-dev benchmarxin your project folder
- Create one or more benchmark files (format described below), and put them in
- Add a
Makefilesuch as this
(see examples here)
A benchmark file is a Node module which should export the following:
The name of the module/benchmark (for reporting). If not specified, the file's basename will be used.
The version of the module/benchmark. If not specified, benchmarx will attempt
to find the version automatically (by finding a
package.json for the module
If you're benchmarking a middleware, have this function return your middleware function.
Options passed to this function come from
benchmarx --opts <path> (path to a
JSON file containing options).
return require'buffet'optionsroot watch: false;;
If you're benchmarking a server, have this function call
cb(err, port) or
cb(err, "host:port") to tell
benchmarx which port the server is listening on.
var server = require'http'createServerresend'hello world!';;serverlisten0cbnull serveraddressport;;;
If you're benchmarking a server, this function will be called once
is done, so you can clean up your stuff.
Usage: benchmarx.js [options] [files...]Options:-h, --help output usage information-V, --version output the version number-r, --runner <runner> choose slam, ab, or siege (default: slam)-c, --concurrency <num> level of concurrency (default: 10)-t, --time <seconds> length of each benchmark (default: 30)-w, --wait <seconds> wait between benchmarks (default: 10)-p, --path <path(s)/file> URL path(s) to test, can be comma-separated, or newline-separated file (default: /)--opts <path> file path to a JSON file to load options (passed to benchmarks)-o, --out <outfile> write results to a file--title <title> title for the header--no-random disable random benchmark order
benchmarx.js v0.1.0Tue Aug 28 2012 20:56:14 GMT-0700 (PDT)buffet@~0.4.0-------------slam v1.0.2Tue Aug 28 2012 20:56:14 GMT-0700 (PDT)slamming x5 for 2s...Transactions: 13116 hitsAvailability: 100.00 %Elapsed time: 2.02 secsData transferred: 4.30 MBResponse time: 0.00 secsTransaction rate: 6486.64 trans/secThroughput: 2.12 MB/secConcurrency: 4.26Successful transactions: 13116Failed transactions: 0Longest transaction: 0.11Shortest transaction: 0.00buffet-server@~0.4.0--------------------slam v1.0.2Tue Aug 28 2012 20:56:18 GMT-0700 (PDT)slamming x5 for 2s...Transactions: 15551 hitsAvailability: 100.00 %Elapsed time: 2.21 secsData transferred: 5.10 MBResponse time: 0.00 secsTransaction rate: 7008.11 trans/secThroughput: 2.29 MB/secConcurrency: 2.94Successful transactions: 15551Failed transactions: 0Longest transaction: 0.21Shortest transaction: 0.00SUMMARY-------**************** buffet-server (7008.11 rps)*************** buffet (6486.64 rps)
Developed by Terra Eclipse
Terra Eclipse, Inc. is a nationally recognized political technology and strategy firm located in Aptos, CA and Washington, D.C.
- Copyright (C) 2012 Carlos Rodriguez (http://s8f.org/)
- Copyright (C) 2012 Terra Eclipse, Inc. (http://www.terraeclipse.com/)
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.