Benchmark comparison
authorTom Jackson <tjackson@fb.com>
Wed, 4 Oct 2017 17:31:05 +0000 (10:31 -0700)
committerFacebook Github Bot <facebook-github-bot@users.noreply.github.com>
Wed, 4 Oct 2017 17:41:27 +0000 (10:41 -0700)
commitf20581a4b094f9d773c19da307b2f1f45757f84a
tree62506b6dce738e0c6c7bb7b2d142377386b69d7c
parentb2d64a0a3e797231391d9ce373f7c0109793d287
Benchmark comparison

Summary:
I couldn't find anything that consumes `--json` output, so I made this. It prints out benchmark results from two runs, comparing each benchmark to its corresponding baseline. This should help with benchmarking changes across revisions.

Along the way:
- Two small transparent `struct`s replaces the use of `tuple`s everywhere.
- New output JSON format (additive), formatted as array of arrays so order is preserved.
- New comparison binary in `folly/tools/benchmark_compare`

Sample output:

{P58307694}

Reviewed By: yfeldblum

Differential Revision: D5908017

fbshipit-source-id: d7411e22b459db16bd897f656e48ea4e896cb1bf
folly/Benchmark.cpp
folly/Benchmark.h
folly/tools/BenchmarkCompare.cpp [new file with mode: 0644]