← Back to context

Comment by brendangregg

10 months ago

Those are microbenchmarks.

pgbench is not a microbenchmark.

  • From the docs: "pgbench is a simple program for running benchmark tests on PostgreSQL. It runs the same sequence of SQL commands over and over"

    While it might call itself a benchmark, it behaves very microbenchmark-y.

    The other numbers I and others have shared have been from actual production workloads. Not a simple program that tests same sequence of commands over and over.

    • While pgbench might be "simple" program, as in a test-runner, workloads that are run by it are far from it. It runs TPC-B by default but can also run your own arbitrary script that defines whatever the workload is? It also allows to run queries concurrently so I fail to understand the reasoning of it "being simple" or "microbenchmarkey". It's far from the truth I think.

    • The are loads of real world workloads that have similar patterns to pgbench, particularly read only pgbench.