TiDB Sysbench Performance Test Report -- v2.0.0 vs. v1.0.0

Test purpose

This test aims to compare the performances of TiDB 1.0 and TiDB 2.0.

Test version, time, and place

TiDB version: v1.0.8 vs. v2.0.0-rc6

Time: April 2018

Place: Beijing, China

Test environment

IDC machine

TypeName
OSlinux (CentOS 7.3.1611)
CPU40 vCPUs, Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
RAM128GB
DISKOptane 500GB SSD * 1

Test plan

TiDB version information

v1.0.8

ComponentGitHash
TiDB571f0bbd28a0b8155a5ee831992c986b90d21ab7
TiKV4ef5889947019e3cb55cc744f487aa63b42540e7
PD776bcd940b71d295a2c7ed762582bc3aff7d3c0e

v2.0.0-rc6

ComponentGitHash
TiDB82d35f1b7f9047c478f4e1e82aa0002abc8107e7
TiKV7ed4f6a91f92cad5cd5323aaebe7d9f04b77cc79
PD2c8e7d7e33b38e457169ce5dfb2f461fced82d65

TiKV parameter configuration

  • v1.0.8

    sync-log = false grpc-concurrency = 8 grpc-raft-conn-num = 24
  • v2.0.0-rc6

    sync-log = false grpc-concurrency = 8 grpc-raft-conn-num = 24 use-delete-range: false

Cluster topology

Machine IPDeployment instance
172.16.21.11tidb 1pd 1*sysbench
172.16.21.21tidb 1pd 1*sysbench
172.16.21.31tidb 1pd 1*sysbench
172.16.11.41*tikv
172.16.11.51*tikv
172.16.11.61*tikv
172.16.11.71*tikv
172.16.11.81*tikv
172.16.11.91*tikv

Test result

Standard Select test

VersionTable countTable sizeSysbench threadsQPSLatency (avg/.95)
v2.0.0-rc63210 million128 * 32019361.9033 ms/5.67667 ms
v2.0.0-rc63210 million256 * 32081303.69333 ms/8.90333 ms
v2.0.0-rc63210 million512 * 32117887.23333 ms/15.59 ms
v2.0.0-rc63210 million1024 * 321286814.5933 ms/43.2133 ms
v1.0.83210 million128 * 31886862.03667 ms/5.99 ms
v1.0.83210 million256 * 31950903.94 ms/9.12 ms
v1.0.83210 million512 * 32030127.57333 ms/15.3733 ms
v1.0.83210 million1024 * 320593214.9267 ms/40.7633 ms

According to the statistics above, the Select query performance of TiDB 2.0 GA has increased by about 10% at most than that of TiDB 1.0 GA.

Standard OLTP test

VersionTable countTable sizeSysbench threadsTPSQPSLatency (avg/.95)
v2.0.0-rc63210 million128 * 35404.22108084.487.2033 ms/110 ms
v2.0.0-rc63210 million256 * 35578.165111563.3167.673 ms/275.623 ms
v2.0.0-rc63210 million512 * 35874.045117480.9315.083 ms/674.017 ms
v2.0.0-rc63210 million1024 * 36290.7125814529.183 ms/857.007 ms
v1.0.83210 million128 * 35523.9111047869.53 ms/88.6333 ms
v1.0.83210 million256 * 35969.43119389128.63 ms/162.58 ms
v1.0.83210 million512 * 36308.93126179243.543 ms/310.913 ms
v1.0.83210 million1024 * 36444.25128885476.787ms/635.143 ms

According to the statistics above, the OLTP performance of TiDB 2.0 GA and TiDB 1.0 GA is almost the same.

Standard Insert test

VersionTable countTable sizeSysbench threadsQPSLatency (avg/.95)
v2.0.0-rc63210 million128 * 331707.512.11 ms/21.1167 ms
v2.0.0-rc63210 million256 * 338741.219.8233 ms/39.65 ms
v2.0.0-rc63210 million512 * 345136.834.0267 ms/66.84 ms
v2.0.0-rc63210 million1024 * 34866763.1167 ms/121.08 ms
v1.0.83210 million128 * 331125.712.3367 ms/19.89 ms
v1.0.83210 million256 * 33680020.8667 ms/35.3767 ms
v1.0.83210 million512 * 34412334.8067 ms/63.32 ms
v1.0.83210 million1024 * 34849663.3333 ms/118.92 ms

According to the statistics above, the Insert query performance of TiDB 2.0 GA has increased slightly than that of TiDB 1.0 GA.