Buildbot should run performance testing to show any performance regressions or improvements before they are found by other means. Preferably on the Intel hardware provided.

The proposal is this:
1. We run a nightly job that executes HammerDB single thread and something like 64 threads (see https://github.com/TPC-Council/HammerDB/tree/master/Docker/scripts/python/maria/tprocc)

2. Weekly or monthly there is a job that runs the same full benchmark as Intel, which is the HammerDB above for 1, 2, 4, 8 threads and then increments of 4 threads until 100 threads.

Part 1 should notify us if there is a statistically significant regression between days. Part 2 should store reports ready to graph somewhere (email?), this will be useful to show performance improvements over time for blogs and conference talks.

This should be against a release build of MariaDB instead of a debug build.