lab-assistant
lab-assistant
is a Puppeteer-based tool that does the grunt work of taking
measurements and figuring out how much of a performance change there is between
two different versions of your site.
This is a useful tool to run every time you're working on a loading performance improvement. It will help you gauge whether the improvement is real and not just placebo, and it'll give you a number to attach to your PR description, blog post, or annual employee self-assessment survey.
Impress your peers with actual numbers!
Usage
The easiest way to use lab-assistant
is with a tool like
npx
:
npx lab-assistant http://v1.mysite.tld http://v2.mysite.tld
Here's the current full set of options (which you can get with --help
):
lab-assistant.js <url> [url2]
Positionals:
url URL to fetch content from.
If `url2` is not specified, this is used for both the new and old
versions, with the application pausing in between to allow for the
version swap.
url2 Second URL to fetch content from.
If specified, this refers to the new version, while `url` refers to
the old version.
Options:
--help Show help [boolean]
-v, --verbose Output more details. [boolean] [default: false]
--headless Whether to use a headless browser.
[boolean] [default: true]
-l, --lighthouse Whether to run the tests through Lighthouse.
Measuring through Lighthouse is significantly slower, and
the results aren't comparable to direct measuring.
[boolean] [default: false]
-r, --repeat The number of measurements to take for each version.
[number] [default: 10]
-t, --throwaway The number of throwaway visits to perform before any
actual measurements.
Keeping it at 1 or increasing the value can help with
stability. [number] [default: 1]
-c, --cpu_slowdown The CPU slowdown throttling to apply (may help achieve
more stable results in CPU-heavy pages). [number]
-m, --metric The metric to consider.
Metrics:
- ttfb: Time to First Byte
- fp: First Paint
- fcp: First Contentful Paint
- dcl: Time to DOMContentLoad event end
- load: Time to Load event end
- lcp: Largest Contentful Paint
- cls: Cumulative Layout Shift
- tti: Time To Interactive (Lighthouse only)
- tbt: Total Blocking Time (Lighthouse only)
[string] [choices: "ttfb", "fp", "fcp", "dcl", "load", "lcp", "cls", "tti",
"tbt"] [default: "load"]
License
lab-assistant is licensed under GNU General Public License v2 (or later).