TiDB TPC-C Performance Test Report -- v3.0 vs. v2.1

Test purpose

This test aims to compare the TPC-C performance of TiDB 3.0 and TiDB 2.1.

Test version, time, and place

TiDB version: v3.0.0 vs. v2.1.13

Time: June, 2019

Place: Beijing

Test environment

IDC machine:

This test uses the open-source BenchmarkSQL 5.0 as the TPC-C testing tool and adds the support for the MySQL protocol. You can download the testing program by using the following command:

git clone -b 5.0-mysql-support-opt https://github.com/pingcap/benchmarksql.git

Test plan

Use BenchmarkSQL to load the data of 1000 warehouses into the TiDB cluster. By using HAProxy, send concurrent requests to the cluster at an incremental number. A single concurrent test lasts 10 minutes.

TiDB version information

v3.0.0

v2.1.13

TiDB parameter configuration

[log]
level = "error"
[performance]
max-procs = 20
[prepared_plan_cache]
enabled = true

TiKV parameter configuration

The default TiKV configuration is used in both v2.1 and v3.0.

Cluster topology

Test result

According to the testing statistics, the performance of TiDB 3.0 has increased by 450% than that of TiDB 2.1.