Continuous Benchmarking

Continuous benchmarking is run on every commit to detect performance regressions in DuckDB. All queries run with a standard timeout of 30 seconds to avoid the benchmark suite from taking too much time to run. Benchmarks are ran using the benchmark runner, and are defined in the benchmark subdirectory of the DuckDB source repository. The following sets of benchmarks are run:

  1. Aggregates
  2. Append
  3. CSV
  4. In
  5. Micro
  6. Startup
  7. Storage
  8. TPC-DS
  9. TPC-H